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FOREWORD 


The  Army  Is  aware  of  the  Increasing  importance  of  training  and  manpower 
estimation  throughout  the  life  cycle  process*  Dollar  and  manpower  require¬ 
ments  are  fixed  very  early  in  system  development  but  their  full  Impact  is 
often  not  apparent  until  years  later*  For  this  reason,  Improved  cost  and 
training  effectiveness  analysis  (CTEA)  has  become  a  major  Army  need* 
Guidance  exists  for  what  analyses  ate  desired,  but  the  state-of-the-art  in 
supporting  technology  has  not  kept  up  wiLii  demands  for  increasingly  precise 
estimates*  As  a  result,  ARI  initiated  a  research  program  on  CTEA  in  1976 
which  was  concerned  with  the  early  estimation  of  training  media,  methods, 
and  costs*  In  1978  the  program  was  expanded  to  Include  training  estimation 
problems  during  a  weapon  life  cycle*  Because  the  developmental  history  of 
no  two  systems  is  identical  the  present  contract  was  designed  to  pull 
together  methods  developed  to  deal  with  individual  cases  and  produce  a 
systematic  procedural  guide  for  an  Army  analyst  tasked  with  CTEA  perfor¬ 
mance*  The  result  of  the  effort  is  in  two  volumes*  Tne  first  examines 
CTEA  requirements  in  the  life  cycle,  the  available  techniques  for  each 
analysis  point,  and  the  R&O  deficiencies*  This  second  is  a  user's  guide 
implementing  the  first  volume  into  a  step-by-step  procedure  for  CTEA 
performance  using  actual  field  data  sources  and  examples*  This  research 
is  in  response  to  Army  project  2Q2637A3A79A  and  special  needs  of  the 
Directorate  of  Training  Developments,  Ft*  Bliss,  Texas. 


— , 

JOSEPH  24^NER 
Technical  Director 
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HDW  TO  USE  THIS  PERFORMANCE  GUIDE 


1.  Determine  the  purpose  of  your  CPEA;  e.g.,  does  the  CTEA  have  to 
be  a  complete  cost  and  training  effectiveness  analysis  or  is  it 
only  to  resolve  sane  specific  issue  or  issues?  (See  Section  I.) 

2.  Refer  to  the  General  CTEA  Model  (Figure  II-1)  to  help  you  assess 
what  data  are  available  to  you.  (See  also  the  text  in  paragraj^ 
IIB  s*- anting  on  page  II-3.) 

3.  Detennine  the  specific  issues  that  require  i-^solution.  (See 
discussion  in  paragraph  IIC  starting  on  page  II-5  and  Table  II-2 
on  page  11-16.) 

4.  Study  the  series  of  strategies  for  performing  CTEA  discussed 
in  paragraph  IID  starting  on  page  II-6. 

5.  Proceed  tc  Table  II-3  (page  11-17),  ”How  to  Proceed  from  Here.”  j 
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SECTION  I 


INTRODUCTION 


A.  Purpose  of  this  Performance  Guide 

This  is  a  "how  to"  manual.  It  shows  an  analyst  how  to  perform  cost  and 
training  effectiveness  analyses  (CTEA)  during  Weapon  System  Acquisition  required 
by  the  Life  Cycle  System  Management  Model  (LCS^W)  and  other  related  regulations 
and  documents.  The  Manual  assumes  that  the  analyst  has  a  working  knowledge  of 
Army  training  and  task  anaysis  but  may  not  be  an  expert  in  these  fields  or  in 
psychology  or  in  mathematics. 

fou  will  note  throughout  the  Guide  the  frequent  use  of  the  word  "estimate." 
Whatever  the  method  for  CTEA,  you  will  be  dealing  in  estimates  rather  than  with 
exact  measures  and  you  should  be  guided  accordingly.  In  other  words,  It  will 
not  be  worth  your  while  to  strive  for  greater  accuracy  in  your  analyses  than  the 
input  data  warrant. 

B.  Purposes  of  the  CTEA 

1.  Evaluation  of  the  ease/difficulty  of  training  system  tasks. 

CTEAs  supply  evaluations  of  the  training  subsystems  at  several  points 
in  the  process  of  system  acquisition.  The  evaluations  allow  system  performance 
to  be  judged  (and  acquisition  decisions  made)  based  on  estimates  of  soldiers' 
proficiency  on  the  various  tasks.  The  CTEA  thereby  identifies  those  tasks 
likely  to  be  difficult  to  train,  providLng  the  Armiy  with  a  basis  for  requesting 
modifications  in  the  hardware  or  in  the  tasks. 


2.  Detenoinaticn  of  the  relative  merits  of  alternative  training  plans. 


nhere  alternative  training  plans  I'ravc  been  proposed,  t.hs  CTEA  assesses 
the  likelihooQ  of  each  plan  producing  soldiers  trained  to  criterion  level  or 
that  level  at  which  they  perform  the  tasks  to  the  required  standards.  The 
comparison  of  alternatives  is  done  for  each  task  or  group  of  tasks,  enabling 
a  choice  of  the  more  effective  plan  or  a  combination  of  the  more  effective 
elements  of  several  plans. 


3.  Identification  of  likely  components  of  an  optiiral  training  program. 

Tht  CTEA  examines  the  critical  tasks  to  be  performed  on  a  ceveloping 
system  and  determines  the  training  metheds  most  likely  to  produce  the  required 
proficiency  in  the  soldier. 

ti.  Determination  of  training  subsystem  costs. 

The  CTEA  determines  t.he  cost  cf  t.''aining  soldiers  to  proficie.ncy  on 
the  critical  tasks  of  the  system.  The  impact  of  training  subsystem  cost  on 
the  total  cost  of  t.he  system  can  thereby  oe  evaluated.  The  determination  also 
permits  cost  etttipar'isons  ameng  r.rcccsed  alternative  traini.ng  subsystens. 


C.  CTEA  Products 


1 .  The  CTEA  produces  an  estimate  of  the  effectiveness  of  training  for 
each  task  or  group  of  tasks,  e.g.,  the  percentage  of  trainees  achieving  cri¬ 
terion  level  on  a  test  of  performance  for  each  task  (such  as  SQT  or  end-of- 
course  test) . 

2.  The  CTEA  produces  a  table  of  relative  effectiveness  or  merit,  comparing 
proposed  alternative  training  plans  (wlien  available)  for  each  critical  task. 

The  table  may  be  defined  in  terms  of  relative  proficiency  measures  or  in  terms 
of  the  proportion  of  necessary  training  elements  or  variables  included  in  the 
alternative  plans. 

3.  The  CTEA  produces  a  list  of  those  training  elements  or  variables 
deemed  necessary  and,  depending  on  the  method  or  approach  selected,  may  show 
training  deficiency  (where  a  training  requirement  is  not  matched  by  the  training 
program) ,  training  excess  (where  training  elements  in  the  training  program  are 
not  required  by  the  task  aescription) ,  or  training  redundancy  (where  two  or  more 
media  or  methoos  meet  the  same  neeo) . 

4.  The  CTEA  produces  an  estimate  of  the  costs  involved  in  training  the 
soldier  to  operate  and/or  maintain  the  system  in  th:  field. 
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SECTION  II 


PLANNING  THE  CTEA 


A .  Overview 

Various  methods  have  been  developed  for  performing  CTEA.  The  inputs  and 
outputs  of  these  methods  differ  as  do  the  advantages  and  disadvantages  of  each. 

The  gmeral  approach  in  this  Guide  is  to  break  the  CTEA  down  into  its  component 
processes  and  then  to  apply  that  method  which  maximizes  the  advantages  and 
mirjjaizes  the  disadvantages  for  a  particular  process. 

Whatever  the  location  of  the  CTEA  within  the  LCShti,  the  selection  of  methods 
for  the  accomplishment  of  its  various  analytical  processses  is  controlled  pri¬ 
marily  by  the  available  data.  The  Issues  to  be  resolved  and  the  questions  to  be 
answered  by  the  CTEA  must  also  influence  the  selection  of  methods  once  the  nature 
of  the  relevant  data  has  been  determined.  Thus,  methco  selection  begins  with  the 
identification  of  the  basic  analytical  processes  made  necessary  by  the  relative 
sparseness  or  rlc.hness  of  the  data  and  then  proceeds  to  the  selection  of  ways  to 
accomplish  those  processes.  At'ter  these  initial  selections,  the  means  of  address¬ 
ing  the  specific  Issues  and  qcestions  of  the  CTEA  must  be  considered.  This  ap¬ 
proach  to  the  selection  of  CTEA  methods  is  illustrated  in  Figure  II- 1  and  flirther 
explained  below. 


II- 1 


Figure  II-l.  General  CTKA  Model 


B.  Assessment  of  Available  Data 


How  well  a  CTEA  can  be  done  and,  to  some  extent,  where  in  the  system  acqui¬ 
sition  process  it  should  be  done  are  highly  dependent  on  the  amount  and  types 
of  data  available.  As  the  system  progresses  through  the  acquisition  process, 
more  and  better  data  become  available.  The  necessary  data  will  probably  not 
be  readily  available  and  you  will  have  to  look  for  it.  Perhaps  the  most  diffi¬ 
cult  task  in  the  CTEA  will  be  data  collection  —  especially  in  the  early  stages 
of  system  acquisition.  This  will  oe  particularly  true  of  cost  data. 

Once  the  performance  of  a  CTEA  has  been  directed,  you  must  first  ask  whether 
a  training  program  (including  tasks  to  be  trained,  methods  to  train  tasks,  per¬ 
sonnel  to  be  t.'ai.ned,  locations  of  training  for  various  tasks,  etc.)  actually 
exists.  Depending  on  the  answer  to  this  question,  your  analysis  will  proceed 
along  one  of  two  primary  tracks  (Figui’e  II-1). 

1 .  If  there  is  no  training  p.'XJgiam,  determine  if  there  is  a  task  list 
complete  enough  to  permit  design  or  prediction  of  alternative  training  programs 
(at  least  for  the  mission-critical  tasks). 

0  If  there  is  no  such  task  list,  or  if  it  is  not  complete 
enough  to  develop  alternative  training  programs,  a  task 
list  must  be  generated. 

0  Once  a  task  list  has  been  generated,  or  you  have  determined 
that  a  complete  enough  task  list  exists,  select  a  method  or 
methods  for  the  training  prediction  process. 

o  After  selecting  these  methods,  select  methods  for  the  re¬ 
maining  processes: 

0  estimation  of  effectiveness 

0  costing  of  training  program  alternatives 

0  cost  effectiveness  comparisons  of  training  p.rograms 

0  resolution  cf  issues 

2.  If  there  is  a  troining  program,  analysis  will  proceed  along  the  other 
primary  track  (Figure  II-':}. 

o  Detenaine  if  there  are  performarice  data  complete  enough  and 
valid  enough  to  pormic  empirical  evaluation  (based  on  actual 
performance)  cf  the  effectiveness  of  the  training  program 
alternatives. 

0  If  there  are  no  such  data,  select  a  method  or  methods 
for  estimating  effectiveness. 

0  If  there  are  performance  data,  determine  if  these  are 
based  on  a  single  program  or  on  a  set  of  program 
alternatives. 
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-If  there  are  no  such  alternatives,  determine  how 
to  predict  or  develop  alternatives,  and 

-  determine  how  to  estimate  the  effectiveness  of  the 
alternatives. 


0  costing  of  training  program  alternatives 
0  cost  effectiveness  comparisons  of  training  programs 


0  resolution  of  issues 


C.  Issues  Requiring  Resolution 


The  issues  which  you  must  address  in  order  to  assist  the  decision-makers 
vary  with  the  particular  phase  of  the  system  acquisition  process.  During  Phase 
I,  Conceptual,  the  main  questions  will  pi obably  be: 

0  To  what  extent  is  the  basic  concept  trainable? 

0  What  training  program  eleooits  (e.g.,  delivery  approach,  media) 
should  be  included  in  the  program? 

0  VJhat  is  the  estimated  cost  of  training  the  required  nunber  of  people 
to  proficiency  on  the  system? 

As  more  data  become  available  in  Phase  I  with  the  development  of  the  Letter 
of  Agreement  (LOA)  and  organizational  and  operational  concepts,  the  CTEA  can  be 
updated.  You  should  now  consider  issues  such  as:  ' 

0  What  is  the  relative  trainability  of  alternative  concepts? 

o  What  is  the  relative  cost  of  effectiveness  of  the  training  pro¬ 
grams  for  the  altennative  concepts? 

As  the  acquisition  process  moves  into  Phase  II,  Demonstration  and  Valida¬ 
tion,  more  data  become  available,  such  as  Section  V  (Training  Plan)  of  the 
Outline  Acquisition  Plan  (OAP)  and  the  results  of  DT/OT  I.  The  issues  of  train- 
ability  and  relative  cost  effectiveness  of  alternatives  remain.  Now,  however, 
your  CTEA  should  resolve  the  issue  of  necessary  revisions  of  the  training  pro¬ 
grams.  .As  the  Provisional  Qualitative  and  Quantitative  Personnel  Requirements 
Information  (PQQPRI)  becomes  available,  you  will  want  to  update  your  CTEA  to 
help  resolve  the  issues  of  training  device  requirements  (TDR)  and  the  relative 
cost  effectiveness  of  the  revised  trai.ning  programs.  Trainability  of  these 
programs  remains  an  issue. 

When  the  acquisition  cycle  moves  into  Phase  III,  Full  Scale  Development, 
enough  additicnal  data  should  have  been  generated  to  warrant  another  CTEA. 

Events  t.hat  provide  the  additional  data  are  the  beginning  of  New  Equipment 
Training  (NET)  based  on  the  NET  Plan,  approval  of  the  Acquisition  Plan  (AP), 
the  results  of  DT/OT  II,  the  evaluation  of  the  effect  the  new  system  will  ^«ive 
on  ARTEP,  draft  training  progi'ams,  and  field  manuals  (FM).  The  primary  issues 
to  be  resolved  by  this  CTEA  are: 

0  the  performance  data  f.'xm  DT/OT  II  versus  the  stajidards  of  per¬ 
formance  developed  in  the  training  plans  and  docunents 

0  the  impact  of  the  performance  data  on  hardware  and  training  — 
program  design,  personnel  selection,  hardware  modification,  etc. 

This  CTEA  should  be  updated  in  Phase  IV,  Production  and  Development,  based 
on  DT/CT  Hi  ftepcrts,  reviaict.;*  wf  training  plinc  c:.d  programs  (e.g.,  ^"5  tRTEPH 
FM,  and  Section  V  of  the  DF.  An  update  may  be  occasioned  during  deployment  if 
there  is  a  product  improvement  or  modification  program.  The  primary  issue  to 
be  addressed  in  this  phase  is  the  co.et  effactivences  of  the  revise!  program. 
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D.  Strategies  for  Conducting  the  CTEA 


In  order  to  assist  you  in  conducting  the  CTEA  and  selecting  methods  to  per¬ 
form  the  CTEA,  the  following  strategies  or  general  plans  have  been  developed. 
While  they  do  not  cover  every  conceivable  situation,  they  do  cover  those  situ¬ 
ations  that  can  be  reasonably  expected  to  occur. 

Strategy  1 

Situation;  There  is  no  training  program  and  there  is  no  complete  task  list 
Processes  Required  by  the  General  CTEA  Model; 

0  Generation  of  a  task  list 

o  Prediction  of  training  programs 

o  Estimation  of  effectiveness 

0  Costing  of  training  programs 

o  Comparison  of  training  program  alternatives 

o  Resolution  of  issues 

Elements; 

0  Generation  of  a  task  list.  Determine  the  status  of  the  task  information 
and  choose  an  appropriate  method.  If  the  CTEA  is  to  be  done  early  in  an  acquisi 
tion  program  —  that  is,  during  the  conceptual  phase  —  a  rudimentary  task  list 
na>y  be  adequate  though  it  should  be  as  refined  as  is  possible  within  CTEA  study 
resources.  The  ’’generic  CTEA”  processes  used  for  the  DIVAD  Gun  ro<i.y  be  useful. 

If  tasks  can  inferred  from  a  contractor’s  draft  TM  or  from  knovdedge  of  an 
antecedent  system,  use  a  process  like  the  HAWK  Product  Improvement  Program  (PIP) 
Training  Development.  If  the  CTEA  is  to  be  dene  in  a  later  stage  of  acquisition 
deenwstration  and  validation  phase  or  later  —  a  rudimentary  task  list  probably 
will  not  be  adequate,  and  considerable  effort  should  go  into  producing  a  refined 
task  list.  If  you  have  cetailed  knowledge  of  the  antecedent  syst'jm,  use  the 
ROLAND  Training  Development  Process  to  generate  the  task  list.  (See  Table  II- 1) 

o  Preciculon  of  training  program  alternatives.  Predict  or  estimate  train¬ 
ing  prograi;;  alternatives  in  several  ways.  Estimate  one  training  program  on  the 
basis  of  expert  k.nowledge  of  tne  weapons  or  materiel  system  urider  i;ivestigatior. 
or  expert  knowledge  of  the  class  of  weapons  or  materiel  systems  to  which,  the 
developing  system  belongs.  .Then  use  an  analytical  method  such  as  tiie  Training 
Efficiency  Estimation  Mocel^  (TEEM)  or  the  ModiHed  T.-mning  Effectiveness, 

Cost  Effectivesness  Prediction  Technique  (TECEP)^  to  predict  one  or  more  alter¬ 
natives.  (See  Table  II-).) 


'Jorgensen  a.nd  Hoffer,  Preoiction  vf  It  airii.~.g  P.r:p,ram?  fnr  Use  in  Cost 
Training  Effectiveness  Analysis,  1975. 

‘^Braby  et.al. ,  A  Technique  for  Chcosing  Cost-Effective  Instructional 
Delivery  Systems,  TAZG  r.epcrt  N'o.  lo,  19”'. 
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Such  a  procedure  allows  the  prodiicts  of  expert  judgment  to  be  compared 
with  the  products  of  analytical  methods  and  vice  versa.  Wide  differences  in 
the  training  programs  predicted  or  estimated  by  two  such  divergent  methods  can 
identify  areas  that  require  closer  examination. 

o  Estimation  of  ef f.=:Otiveness .  In  the  case  of  a  training  program  estimated 
on  the  basis  of  expert  kn^ledge,  estimate  effect ivenes*?  also  on  the  basis  of 
expert  knowledge.  If  a  task  under  examination  is  similar  to  a  task  in  an  exist¬ 
ing  system  about  which  the  analyst  has  knowledge,  and  if  it  is  known  that  a 
certain  traini.ng  approach  results  in  the  required  level  of  proficiency  on  the  task, 
the  training  approach  may  be  estimated  to  be  roughly  as  effective  in  training  the 
new  task  as  in  training  the  existing  task.  If  the  Analogous  Task  Method  (ATM,  a 
formal  analytical  procedure)  has  been  used  to  predict  a  training  program  alterna¬ 
tive,  use  it  also  to  estimate  the  effectiveness  of  that  program.  If  TEEM  has  been 
employed  to  estimate  two  or  more  alternatives,  the  efficiency  ratios  become  the 
estimates  of  effectiveness.  No  matter  now  the  training  program  alternatives 
have  been  predicted  or  estimated.  Training  Consonance  Analysis  (TCA)^  may  be 
used  to  estimate  effectiveness.  The  training  consonance  ratios  (TCR)  produced 
by  the  method  become  the  estimates  of  effectiveness.  (3ee  Table  II-l.) 

o  Costing  of  training  progryn  alternatives.  Use  the  modified  TECEP  (TAEG 
#16)  Cost  Model  fi  estimate  costs  ,  Any  cost  model  that  yields  satisfactory 
cost  estimates  may  be  used,  but  this  one  is  automated,  comprehensive,  and 
apparently  satisfactory  for  Army  acquisition  decisions,  (See  Table  11-1  and 
Section  IIID,  p.  III-77J 

0  Comparison  of  training  program  alternatives.  Compare  training  programs 
first  on  the  oasis  of  estimated  cost  and  estimated  effectiveness.  Form  cost/ 
effectiveness  (C/E)  ratios  (estimated  cost  over  estimated  effectiveness,  but 
all  estimates  must  be  in  the  same  terms,  i.e.,  produced  by  the  same  method)  and 
tentatively  olioose  the  lower  value  since  it  represents  the  lowest  or  lower  cost 
per  "unit"  of  effectiveness.  Decide  which  estimated  level  of  effectiveness  is 
acceptable  (not  totally  a  juagmental  process;  see  TEEM)  and  eliminate  or  revise 
alternatives  with  a  lower  estimated  effectiveness.  Defer  final  selection  or 
recommendation  of  a  training  orogram  alternative  until  all  issues  have  been  re¬ 
solved.  It  may  be,  for  examiple,  that  the  training  program  with  the  highest  C/E 
value  m.ay  be  nhe  best  choice  when  considered  in  the  light  of  training  risk. 

This  would  be  the  case  if  a  training  pr-ogram  were  estimated  to  be  more  effective 
in  training  certain  high-risk  tasks  out  were  also  estimated  to  be  somewhat  more 
costly  than  the-  next  best  prcg.''a.T.  Possible  impacts  of  training  risk  may  indi¬ 
cate  that  the  more  effecti/e  Drogram  is  worth,  the  higher  costs.  Refer  to  Table 
II-l  and  read  tne  techniques  referred  to  under  Ccluon  F,  Resolution  of  Issues. 
These  issues  may  correspond  to  yours  cr  si.milar  techniques  may  be  useful  in  re¬ 
solving  tne  issues  you  must  address. 

o  Resolution  of  issues.  Identify  issues  or  questions  (frequently  referred 
to  as  EEA  fer  essential  elements  of  analysis)  not  itready  resolv^  by  the  pre¬ 
ceding  processes,  and  choose  or  cevelop  approaches  to  them.  These  approaches 
may  induce  reoomendations  for  further  studies  cr  tests.  (See  Table  II-l.) 


^.Hawley  and  "h.omascr. ,  Develcpr.ent  of  2:1  Air  Defense  Cost  and  Training 
iffectivcr.eis  A.nalysis  Met.nccolcgy,  2  vcl.,  197b. 
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strategy  2 

Situation;  There  is  no  training  program  but  there  is  a  complete  task  list. 

Processes  Required  by  the  General  CTEA  Model: 

0  Prediction  of  training  programs 

0  Estimation  of  effectiveness 

0  Costing  of  training  programs 

0  Comparison  of  training  program  alternatives 

0  Resolution  of  issues 

'  Elements; 

0  Prediction  of  training  program  ^ternatives.  As  in  Strategy  1 ,  estimate 
training  program  alternatives  in  several  ways,  including  both  informal  methods 
based  on  expert  judgment  and  formal  analytical  methods  such  as  TEEM,  TECEP,  ATM, 
and  DIVAD  Gun.  Compare  the  results  of  the  various  methods  and  resolve  differ¬ 
ences.  Be  aware  that  if  the  arialyst  faces  the  situation  very  early  in  an  acqui¬ 
sition  program,  the  training  program  predictions  or  estimations  need  not  be  as 
precise  as  they  will  need  to  be  at  later  stages.  Still,  make  predictions  or 
estimations  as  precisely  as  the  task  information  permits.  (See  Table  II-1.) 

0  Estimation  of  effectiveness.  Estimate  effectiveness  as  in  Strategy  1. 

Be  aware  that  the  state  of  the  task  information  (a  rudimentary  task  list,  a  some¬ 
what  refined  task  list,  or  a  set  of  fully  developed  task  statements)  determines 
the  precision  with  which  training  programs  may  be  predicted  or  estimated  and 
their  effectiveness  estimated. 

o  Costing  cf  training  programs.  Cost  training  programs  as  in  Strategy  1 . 

Be  aware  that  the  precision  or  accuracy  of  cost  estimates  depends  on  the  preci¬ 
sion  or  accuracy  of  estimation  of  training  programs.  (See  Table  II-1.) 

0  Comparison  of  training  program  alternatives.  Compare  training  program 
al tematives  as  in  St.^ategy 

o  Resolution  of  issues.  Resolve  issues  as  in  Strategy  1 .  Because  the 
situation  that  this  strategy  addresses  is  likely  to  occur  dtu'ing  the  concept  ex¬ 
ploration  phase  of  an  acquisition  program  when  competing  materiel  concepts  are 
being  explored,  be  especially  aware  that  the  issue  of  trainability  is  important. 
(See  Table  II- 1 . ) 


strategy  3 


Situation;  There  is  a  training  program  but  there  are  no  alternatives  and 
no  effectiveness  data. 

Processes  Required  by  the  General  CTEA  Model: 
o  Prediction  of  craining  programs 

0  Estimation  of  effectiveness 

o  Costing  of  training  programs 
0  Comparison  of  training  program  alternatives 

o  Resolution  of  issues 

Elements : 

o  Prediction  of  training  program  alternatives.  Use  a  formal  analytical 
procedure  such  as  TEEM,  TECEp7  or  ATM  to  predict  training  program  alternatives 
to  be  compared  with  the  existing  training  program.  A  method  based  on  informal 
expert  knowledge  may  also  be  used,  but  because  of  the  method  to  be  used  in  the 
comparison  of  training  program  alternatives  the  details  and  relative  precision 
of  the  fortnal  analytical  pr<x:edures  will  be  useful.  Whatever  the  method  em¬ 
ployed,  consider  different  levels  of  training  device/media  usage,  especially 
levels  different  from  those  in  the  existing  program,  and  different  methods. 

(See  Table  II- 1.) 

0  Estimation  of  effectiveness.  Use  TCA  to  estimate  the  effectiveness  of 
both  the  existing  training  program  and  the  predicted  training  programs.  This 
method  yields  both  values  (TCRs)  which  may  be  taken  as  estimates  of  effectiveness 
and  diag.nostic  information  (training  deficiencies,  excesses,  and  redundancies) 
which  may  be  usea  to  reconmend  revisions  of  the  existing  training  program.  A 
method  based  on  expert  knowledge/ judgment  may  also  be  employed,  but  because  one 
training  program  actually  exists  while  the  alternatives  have  only  been  predicted 
(i.e.,  described)  the  possibility  of  biased  estimates  exists.  (See  Table  II-1.) 

o  Costi.ng  of  training  programs.  Cost  training  programs  as  in  Strategy  1 . 
Because  one  training  program  to  be  costed  actually  exists  while  the  aiuernatives 
Itave  only  been  predicted  or  estimated,  be  aware  that  cost  estimates  must  be 
comparable  in  level  of  detail  and  precision  if  valid  cost  comparisons  are  to 
be  made.  (See  Table  II-1.) 

o  Comparison  of  training  program  alternatives.  Compare  training  program 
alternatives  using  the  TCRs  as  estimates  ot  effectiveness.  Combine  alternatives 
on  the  basis  of  effectiveness  and  costs.  Form  cost/effectiveness  (C/E)  ratios 
as  in  Strategy  1  and  tentatively  choose  the  lowest  or  lower  value  since  it  repre¬ 
sents  the  lowest  or  lower  cosi:  pe,-  "'unit"  of  effectiveness.  Then  note  the  re¬ 
lationship  of  the  TCRs:  if  the  TCRs  of  one  or  more  predicted  alternatives  are 
higher  t.han  the  TCR  of  th.e  actual  training  program,  compare  the  media  ana  methods 
of  the  predicted  alternatives  —  task  by  task  —  with  the  media  and  methods  of 
the  actual  training  program.  Also  examine  the  actual  f^aLning  program  in  light 
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of  its  own  diagnostic  inforaiation  (training  deficisnciss,  excesses,  arxl  red^.- 
dancies)  and  the  diagnostic  information  pertaining  to  predicted  alternatives 
with  higher  TCRs.  This  information  can  be  used  to  reconmend  revisions  of  the 
actual  training  program  that  will  cause  its  TCR  and  thus  its  estimated  effective¬ 
ness  to  increase.  The  adoption  of  one  of  the  predicted  alternatives  may  also  be 
recooinended,  should  comparison  of  C/E  values  warrant,  but  defer  final  selectiori 
or  recommendation  of  a  training  program  until  all  issues  have  been  resolved. 

See  comparison  of  training  program  alternatives  in  Strategy  1 . 

0  R^lution  of  issues.  Ftesolve  issues  as  in  Strategy  Necessary  re¬ 
visions  of  the  existing  training  program  are  likely  to  constitute  an  important 
issue,  but  the  resolution  of  it  will  have  been  accomplished  during  the  compari¬ 
son  of  training  program  alternatives. 

Strategy  4 

Situation;  There  is  a  training  program  with  effectiveness  data  but  there 
are  no  alternatives. 

Processes  Required  by  the  General  CTEA  Model: 

0  Prediction  of  training  programs 

0  Estimation  of  effectiveness 

0  Costing  of  training  programs 

0  Comparison  of  training  progra.m  alternatives 

0  Resolution  of  issues 

Elements; 

0  Prediction  of  training  program  alternatives.  Predict  training  program 
alternatives  as  in  Strategy  3- 

0  EstLmation  of  effectiveness.  Estimate  the  effectiveness  of  all  alter¬ 
natives  (the  existing  training  p.-^jgram  and  the  predicted  alternatives)  as  in 
Strateg}'  3.  There  are  effectiveness  data  for  the  existing  training  program, 
probably  performance  measures  from  DT/OT,  but  the  comparison  of  alternatives 
requires  a  conjncn  measure,  anc  this  can  be  provided  only  througn  estimates  of 
effectiveness  such  as  TCRs.  The  TCRs  and  associated  diagnostic  information 
will  be  used  in  comparison  of  training  program  alternatives  as  a  basis  for 
."ecocnmending  changes  in  the  existing  training  prgram  or  the  adoption  of  an 
alternative. 

0  Costing  of  t.^aining  programs.  Cost  training  programs  as  in  Strategy  1 . 

3e  aware  that  cost  estimates  must  be  comparabie  in  level  of  detail  and  precision 
if  valid  cost  comparisons  are  to  be  made. 

0  Comparison  of  training  program  alte.^natives.  If  the  effectiveness  data 
of  the  existing  training  programs  are  performance  measures  (from  DT/OT),  deter¬ 
mine  if  L.here  are  ass-xiated  task/trsiining  objective  standards  or  test  criteria. 


If  there  are  none,  proceed  as  in  Strategy  3,  comparison  of  training  program 
alternatives .  If  there  are  standards  or  test  criteria,  determine  if  the  perform¬ 
ance  measures  represent  a  deficiency  in  training,  the  required  level  of  training 
proficiency,  or  an  excess  of  training.  Next,  examine  the  TCA  diagnostic  information 
of  the  existing  training  program  to  tentatively  determine  how  that  training  pro¬ 
gram  could  be  revised  to  reduce  or  eliminate  training  deficiencies  or  excesses 
in  training.  Then,  aetermine  which  of  the  predicted  alternatives  have  TCRs 
higher  than  the  TCR  of  the  existing  training  program  and  compare  these  alterna¬ 
tives  —  task  by  task  —  with  the  existing  training  program  in  order  to  establish 
a  further  basis  for  recotnnending  revisions  of  the  existing  training  program  or 
selection  of  an  alternative.  Finally,  form  C/E  ratios  as  in  Strategy  1,  com¬ 
parison  of  training  program  alternatives,  and  tentatively  select  the  program 
with  the  lowest  or  lower  C/E  value  since  the  program  represents  the  lowest  cost 
per  "unit"  of  effectiveness.  But  if  standards  or  criteria  exist  and  the  existing 
training  program  represents  a  training  deficiency,  the  existing  training  program 
in  its  unrevised  form  must  be  eliminated  from  selection.  Compute  a  TCR  for  the 
existing  training  program  revised  as  recommended,  revise  the  cost  estimate  ac¬ 
cordingly,  and  form  a  new  C/E  ratio.  Compare  the  C/E  values  of  the  predicted 
alternatives  with  the  new  C/E  value.  Again,  choose  the  lowest  or  lower  C/E 
values,  but  be  aware  that  the  cost  estimates  of  predicted  alternatives  must 
include  all  development  costs  while  the  cost  estimate  of  the  existing  training 
will  include  fewer  development  costs  or  perhaps  none  at  all.  If  the  selection 
finally  made  is  an  existing  training  program  with  excesses  or  redundancies,  use 
the  TCA  diagnostic  information  tc  make  recommendations  for  revisions  to  further 
increase  the  cost  effectiveness.  Defer  final  selection  or  recommendations  of  a 
training  prgram  or  training  program  revision  until  all  issues  have  been  resolved. 

o  Resolution  of  issues.  Resolve  issues  as  in  Strategy  1 ,  but  be  aware 
that  training  device  requirements  (TDR)  will  likely  constitute  an  important  is¬ 
sue  and  a  method  fc  r  predicting  or  considering  TDR  must  therefore  be  selected  or 
developed . 


Strategy  5 

Situation:  There  are  training  program  alternatives  but  not  effectiveness 
data  for  all  alternatives. 


Processes  Required  by  the  General  CTEA  Model: 


0 

o 

o 

c 


Esti.Tacion 
Costing  of 
Comparison 
Resolution 


of  effectiveness 
training  preg.^ams 
of  training  program  alternatives 
of  issues 


Elements: 

o  Estimation  of  effectiver.c.  .  Estimate  the  effectiveness  of  all  existing 
alternatives  as  in  Strategy  T-  ^11  alternatives  are  to  be  compared,  includir.g 
these  wit.hout  effectiveness  oata,  ti.^s  is  a  necessary  step. 
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o  Costing  of  training  programs.  Cost  all  existing  training  program  alter¬ 
natives  as  in  Strategy  1 . 

c  Comparison  of  training  program  alternatives.  If  the  effectiveness  data 
for  two  or  more  alternatives  are  performance  measures  associated  with  task/ 
training  objective  standards  or  test  criteria,  first  eliminate  from  considera¬ 
tion  those  alternatives  whose  performance  measures  show  that  their  effectiveness 
is  unacceptable.  Then  compare  the  remaining  alternatives  on  the  basis  of  cost 
and  effectiveness.  Form  C/E  ratios  and  tentatively  select  the  training  program 
with  the  lowest  or  lower  C/E  value  since  it  represents  the  lowest  cost  for  ac¬ 
ceptable  effectiveness.  If  the  effectivaiess  data  are  not  performance  measures 
or  if  there  are  no  associated  standards  or  criteria,  proceed  as  in  Strategy  3, 
comparison  of  training  program  alternatives.  If  there  are  performance  measures 
with  associated  task.'^training'objective  standards  or  test  criteria  for  only  one 
trairJ.ng  program,  proceed  as  in  Strategy  4,  comparison  of  training  program 
alternatives.  If  the  first  case  identified  above  prevails,  compare  all  alter- 
natives  on  the  basis  of  TCRs  (from  TCA).  If  a  training  program  alternative 
without  performance  measures  has  a  higher  TCR  than  the  training  programs  with 
performance  measures,  consider  that  that  program  may  be  more  effective  than 
the  programs  with  performance  measures  and  reconnend  the  collection  cf  perfor¬ 
mance  measures  to  verify  that  greater  effectiveness.  If  the  first  case  identi¬ 
fied  a'Dove  prevails  and  the  measures  of  performance  include  more  than  one  mea¬ 
sure  of  training  effectiveness  (MOTS),  then  use  3DM/CARAF^  to  compute  a  total 
weighted  effectiveness  score  and  use  this  value  to  form  a  C/E  ratio.  Defer 
final  selection  or  reconmendation  of  a  training  program  until  all  issues  have 
been  resolved.  (See  Table  II-’..) 

0  Resolution  of  issues.  Resolve  issues  as  in  Strategy  1 .  Ese  aware 
that  perf'crmance  versus  standards  and  performance  versus  hardware,  training 
program  design,  ar.d  personnel  selection  are  likely  to  constitute  issues  to  be 
resolved. 


Strategy  6 

Situation:  There  are  training  program  alternatives  and  effectiveness  data 
for  all  alternatives. 

Processes  Required  by  the  General  CTEA  Model: 
o  Costing  of  training  programs 
0  Comparison  of  training  program  alternatives 
0  Resolution  of  issues 
Elements: 

o  Costing  of  training  p."ograms.  Cost  all  training  program  alternative?  as 
in  Strategy  ^ . 


'BDM  Sen'ices  Company/ Combined  Arms  Research  ai.d  Analysis  Facility  (DDM/ 

CARAF) ,  Cost  ar.d  Training  Effectiveness  .Analysis  handbook  fcr  Action  Officers, 

1976. 
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o  Comparison  of  training  program  alternatives.  This  strategy  assumes  that 
all  effectiveness  data  are  comparable  and  that  effectiveness  data  are  performance 
measures  associated  with  task/training  objective  standards  or  test  criteria. 
Should  the  assumption  not  be  true,  one  of  the  other  strategies  will  be  applicable. 
First  eliminate  from  consideration  those  alternatives  whose  performance  measures 
show  that  their  effectiveness  is  unacceptable.  (If  all  alternatives  are  thus 
eliminated  from  consideration,  use  TCA  for  diagnosis  and  recommend  revision  and 
further  testing  of  programs.)  Then  compare  the  remaining  alternatives  on  the 
basis  of  cost  and  effectiveness.  Form  C/E  ratios  and  tentatively  select  the 
training  program  with  the  lowest  or  lowar  C/E  value  since  it  represents  the 
lowest  cost  for  acceptable  effectiveness.  If  the  measures  of  performance  in¬ 
clude  more  than  one  measure  of  training  effectiveness  (MOTE),  then  use  BDM/CARAF 
to  con^jute  a  total  weighted  effectiveness  score  and  use  this  value  to  fonn  a  C/E 
rfitio.  If  factors  other  'than  performance  measures  are  to  be  considered  in  the 
selection  orVan  alternative,  follow  the  Diagnostic  Rifle  Marksmanship  Simulators 
(DRIMS)  CTEA®  method.  Defer  final  selection  or  recoonendation  of  a  training 
program  until  all  issues  have  been  resolved.  (See  Table  II-1.) 

0  Resolution  of  issues .  Resolve  issues  as  in  Strategy  ^  .  Be  aware  the 
central  issue  is  likely  to  be  the  cost/ training  effectiveness  of  the  much-revised 
training  program  of  a  system  in  the  production  and  deployment  phase  of  acquisi¬ 
tion.  Performance  versus  standards  ^d  performance  versus  hardware,  training 
program  design,  and  personnel  selection  may  also  be  issues  to  be  resolved. 


^USAIS,  Diagnostic  Rifle  Marksaansiup  Siiulatcrs  Cost  and  Training  Effec¬ 
tiveness  Analysis,  197^. 
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E.  Sunnary 

Table  II-2  is  a  sunmary  table  for  CTEA  in  the  LCSKK.  Table  II-3  is  an 
overview  of  how  to  proceed  from  here. 
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PRIHAKY  LCSMf  EVENTS  ISSUES  IIQUIRING  CTEA  PROCESSES  CANDIDATE 

I.CSW1  YIELOINC  DATA  TO  RESOLUTION  PROBABLY  REQUIRED  STRATEGIES 

PHASE  CTEA  CTEA  _ _ 


PRODUCT!  U.\'  •  TRAINING  PLAN  UPDATE  •  COST  EFFECTIVESS  OF 

and  IV  •  DRAFT  TRAINING  REVISED  TRAINING 

DEPLOYMENT  (update)  PROGRAM  PROGRAM 


TABLE  II-3 


HOW  TO  USE  PROCEED  FROM  HERE 


0  Determine  your  "strategy.”  See  discussion  of  strategies 
above  and  refer  to  Table  II -2. 

0  Examine  the  processes  required  and  methods  recoonended 
for  your  strategy.  Refer  to  the  processes  in  Section  III 
and  methods  to  perform  them. 

o  Select  an  appropriate  method  for  each  process  required 
by  your  strategy. 


o  Generation  of  a  task  list 

o  Prediction  of  training  programs 

o  Estimation  of  effectiveness 

o  Costing  of  training  programs 
o  Comparison  of  training  program  alternatives 

0  Resolution  of  issues 


0  Apply  the  methods 


SECTION  III 


PROCESS  PROCEDURES 


A.  Generation  of  Task  List 

1 .  DIVAD  Gun 

You  nay  be  faced  with  a  situation  where  you  have  no  task  list  and, 
apparently,  no  data  on  which  to  base  the  gaieration  of  such  a  list.  A  CTEA, 
however,  may  still  be  required  as  necessary  to  the  milestone  decisions  of  the 
acquisition  process. 

Use  your  own  subject  matter  expertise  or  find  a  subject  matter  expert 
(SME)  to  help  you  develop  a  list  of  ••generic”  tasks.  For  example,  if  the  de¬ 
veloping  system  is  an  air  defense  system  (such  as  DIVAD  Gun),  you  can  be  fairly 
certain  that  a  basic  task  will  be  ••engage  enemy  aircraft. ••  You  can  also  be 
fairly  certain  that  a  basic  task  will  be  •'maintain  the  system,”  etc.  If  you 
have  any  information  on  or  familiarity  with  the  developing  system,  you  can  then 
develop  more  detailed  tasks.  In  other  words,  there  are  certain  tasks  or  kinds 
of  tasks  that  are  common  to  systems  of  a  similar  class,  and  there  is  consider¬ 
able  information  available  about  the  training  of  those  tasks. 

This  method  of  task  list  generation  is  somewhat  of  a  last  resort  based 
on  the  situation  where  even  the  most  tentative  and  tenuous  CTEA  is  preferable 
to  no  CTEA. 

2.  Improved  Hawk  (Hawk  PIP)  Training  Development 

You  may  be  required  to  generate  a  task  list  for  a  system  modification 
or  product  improvement  program  (PTF).  Where  you  have  a  system  modification, 
many  of  the  tasks  of  the  modified  system  will  be  identical  to  those  of  the  basic 
system,  and  the  training,  t.-’aining  requirements,  and  training  implications  will 
also  be  the  same.  Where  tasks  have  been  added  or  changed,  however,  (through 
the  addition  of  a  materiel  subsystem,  for  example)  you  najist  define  new  tasks. 

In  the  Hawk  PIP  training  development  tasks  were  inferred  from  the  manu¬ 
facturer's  araft  TM  material.  For  example,  the  manufacturer's  draft  TM  (see 
Figure  III-1)  states,  "When  estimatLng  raid  size  of  the  lock,  determine  the  num¬ 
ber  of  targets  in  an  assignment  ...  through  d  below.”  This  task  implies  that 
there  is  a  task,  "determine  raid  size  using  the  Tracking  Adjunct  System.  (TAS).” 

If  you  still  have  difficulty,  you  may  have  to  request  the  actual  equip¬ 
ment  (as  was  done  in  Hawk  PIP)  in  order  to  work  out  problems  on  the  operatiop.al 
system. 


3.  Roland  Training  Development 

a.  Given  such  data  as  the  manui'acturer’s  Logistic  Support  Analysis 
Record  (LSAR)  0  Sheets  and  draft  TM  (and,  if  possible  as  in  the  case  of  Roland 
training  development,  attendance  at  the  mar.ufacturer's  training  course),  develop 
a  task  selection  weni;  sheet  similar  to  the  one  in  Fig’ure  III-2. 


r 


TM  9- 1430- 1526- 15^-..] 

Tubit  J-JS.  OiMfOhtig  Pnicttiurr^  Prrfut’mrH  at  thr  FC-^‘val>"artt 


TAS  Cl 


kM 


18. 


Id. 


6. 


c. 


t. 


*20. 


а. 

б. 
c. 


If  ceA.H'  fire  is  in  effect,  continue;  otherwise,  proceed  to  step  23. 
The  C£.\SE  PIKE  labcS  iti  illuminated. 


When  osiimating  raid  size  after  lock,  determine  the  number  of  targets  in  an  assignment  by 
monitoring  the  doppler  audio  and  PPI  video.  Report  the  number  by  pressing  either  '.he  ONE. 
KEW.  ur  MANY  pushbutton  by  using  the  criteria  in  j  through  d  below. 

NOTE 

'P'ur  TAS  «<)uipp«d  IHaWK  batteries  both  the  TaS  visual  and  noA>TAS  criteria  detailed  belo«'  ihauld 
bi*  used. 

NOTE 

^F»r  IHAWK  batteries  without  TAS.  only  the  non-TAS  criteria  should  be' used. 

^STien  only  one  target  is  visible  on  the  TASdi  spl  ayor  when  only  one  target  is  heard  in  the 
doppler  audio  tone,  and  the  target  video  on  the  PPI  is  unbroken,  press  the  ONE  pushbutton. 

The  ONE  pushbuiton  on  the  Grins  rnn»oleand  iKe O.NElahel  on  the  IBCCstalue 
indicator  illuniinale. 

NVIhen  two  targets  are  visible  on  the  T.ASdlspl  ayor  when  there  is  more  than  one  target  heard 
in  the  doppler  audio  tone,  and  the  target  video  on  the  PPI  is  unbroken,  press  the  FEW 
pushbutton. 

The  FEW  pu:.hbuUon  on  the  Grins  con>ole  and  the  FEW  label  on  the  IBCC  status 
indicator  illuminate. 

When  there  are  more  than  two  targets  visible  on  the  TASdISplayor  when  there  are  many 
targeu  heard  in  the  doppier  audio  tone,  and  the  target  video  on  the  PPI  is  broken  into  many 
targets,  press  the  M.\.VV  pushbutton. 

The  ^1  pii".hliiiii«»n  on  tiu  firiiiij.ei»nM»le  and  the  M  \N^  label  on  the  IGCC 
SlatUM  indiratur  ilUiminate. 

Continue  to  monitor  the  status  of  the  engagement  by  observing  that  the  doppler  audio  tone 
rcmaiiin  steady  and  the  COAST  label  c.xtmguishes.  Report  any  irregular  indications. 

Continue  to  monitor  the  targe;  on  the  TASdisplay.Report  target  type,  weapons  store,  and 
J.trget  maneuver,  if  diccernible. 


If  more  than  one  urgei  is  visible  on  the  T.AS  display; 

.Manually  acquire  a.n  outlying  target  (a  target  at  t.he  edge  of  the  formation)  using  the  small 
gate  target  acquisition  procedure  t.itep.l«>|. 

?ress  the  TAS  SUVcD/:.n:c?  i.ndicator-switc.h  to  SLAVED. 

Press  the  TAS  PI  C.'.’/Pl  OFF  l.ndicator-S'witch  to  PI  CN. 

Figure*  Ill-l.  Reproauccion  of  Page  from  .Manufacturer's  Draft  TM 
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b.  Go  through  the  tasks  on  the  LSAS  D  Sheets  and  find  them  in  the 
draft  TM.  The  draft  TM  will  usually  be  a  refinement  and  expansion  of  the  LSAR 
tasks.  List  the  tasks  on  the  task  selection  worksheet.  Ask  the  manufacturer 
(through  appropriate  channels)  to  explain  where  necessary. 

c.  Apply  your  subject  matter  expertise  and  military  judgment  to  rating 
these  tasks  on  the  worksheet  for: 

(1)  Nunber  of  people  performing  the  task  (colio'in  c) 

v2)  Time  spent  in  performing  the  task  (colimn  d) 

(3)  Consequences  of  inadequate  performance  (COIF)  (colunn  e) 

(U)  Task  delay  tolerance  (TDT)  or  effect  on  mission  if  not 
done  in  time  (colunn  f) 

(5)  Task  learning  difficulty  (TLD)  (colunn  g) 

(6)  Task  frequency  or  how  often  the  task  is  performed 
(colunn  h) 

d.  In  colunns  i-n,  place  an  x  in  each  task  cell  for  the  tasks  that 
scored  at  least  the  nunber  shown  in  the  colunn  heading.  For  example,  in  colunn 
i  for  task  #1,  place  an  x  if  the  colunn  c  entry  is  5  or  6.  It  is  5  so  an  x  is 
shown.  For  colunn  j  the  criterion  is  tiiat  colunn  d  entry  be  4  or  higher.  The 
colunn  d  entry  for  task  #1  is  3  so  enter  a  0.  Do  this  for  all  tasks. 

e.  Refer  to  the  "Truth  Table"  at  the  top  right  of  the  worksheet.  Find 
the  horizontal  line  of  X's  and  0‘s  that  corresponds  to  the  pattern  of  X's  and 
O’s  you  have  entered  for  the  task.  The  "Truth  Table"  then  gives  you  the  entries 
for  that  task  for  colunns  o-r: 

(1)  colunn  o:  is  the  task  critical? 

(2)  colunn  p:  should  the  task  be  taught  as  resident  instruc¬ 
tion  or  extension  instruction? 

(3)  colunn  q:  should  the  task  oe  included  in  the  ARTEP? 

(4)  colunn  r;  should  the  task  oe  included  in  wartime 
training? 

f.  Complete  the  Matrix  Task  Inventory  suen  ?s  the  one  shown  in  Figure 

III-3. 
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B.  Prediction  of  Training  Programs 


Certain  kinds  of  learning  are  facilitated  by  particular  types  of  training. 
The  kinds  of  learning  required  are  determined  from  a  study  of  the  learning  ob¬ 
jectives  and,  more  positively,  the  action  verb  in  the  task  statement.  It  is 
this  action  verb  that  is  the  major  clue  as  to  what  it  is  that  the  soldier  must 
do.  Several  methods  have  been  developed  that  assist  the  analyst  in  designing  an 
instructional  delivery  system  based  on  training  objectives  and  their  supporting 
kinds  of  learning.  We  will  first  look  at  those  that  can  help  the  process  of 
predicting  training  program  alternatives. 

1.  TEEM  (Jorgensen  and  Hoffer,  Prediction  of  Training  Programs  for  Use  in 

Cost  Training  Effectiveness  Analysis.  197B)* 

In  the  eeirly  stages  of  development  new  systems  have  no  training  pro¬ 
grams  to  serve  as  a  basis  of  comparison.  In  the  case  of  truly  innovative  sys¬ 
tems,  furthermore,  there  are  no  analogous  systems  with  training  programs  that 
could  provide  base  cases.  A  predictive  computerized  model  for  CTEA  use  has  thus 
been  developed  by  Jorgensen  and  Hoffer  (1978).  Their  methodology,  called  TEEM 
for  Training  Efficiency  Estimation  Model,  begins  with  task  analysis,  proceeds 
through  selection  of  training  media  and  met.hods,  identifies  information  content 
and  structure,  and,  finally,  generates  a  cost/ effectiveness  ratio  for  use  in 
CTEA.  Iterations  of  the  model  may  be  made  for  various  training  weapon  system 
options  in  order  to  produce  cost/ effectiveness  ratios  for  comparison. 

In  this  model  the  trade-offs  made  during  the  generation  of  an  estimated 
training  program  are  recorded.  These  are  used  to  determine  the  potential  deci¬ 
sion  cost  loss  for  the  chosen  training  program  as  compared  with  an  ideal  program 
with  no  constraints.  That  is,  an  ideal,  unconstrained  program  is  quantified  and 
then  compared  with  a  similarly  quantified  real-world  (constrained)  training  pro¬ 
gram.  This  measure  provides  a  standard  of  compa^'ison  for  several  training  pro¬ 
grams  generated  with  the  same  CTEA  method  and  has  potential  advantages  not  only 
for  the  comparison  of  alternative  programs  for  a  given  weapon  system  but  also 
for  comparison  across  systems. 

The  measure,  the  efficiency  ratio,  represents  a  value  composed  of  the 
efficiency  score  of  an  estimated  program  with  real  world  constraints  divided  by 
the  efficiency  score  of  an  idealized  program  with  no  constraints.  Outputs  of 
this  method  also  include  a  costed  training  program.  Input  is  a  task  list  along 
with  sufficient  knowledge  of  the  weapon  system  to  permit  inferences  about  the 
nature  of  stimuli,  responses,  and  feedback. 

TEEM  uses  sets  of  variables  to  describe  both  the  tasks  to  be  learned 
and  the  means  for  training  them  (media  and  methods) .  The  authors  plan  to  add 
other  variables  in  the  future,  but  TEEJ1  can  be  used  to  develop  or  predict  train¬ 
ing  programs  as  it  is  currently  constituted.  Once  the  tasks  and  the  means  for 
learning  have  been  described  in  terras  of  the  same  vau^iables,  matching  is  possi¬ 
ble.  Thus,  when  each  variable  in  the  description  of  the  task  is  matched  by  the 
corresponding  variable  in  the  descriptiois  of  the  training  program,  an  ideal 
training  pregram  has  been  identified.  That  is,  for  each  stimulus,  response. 


•The  procedures  he.-ein  have  been  taken  from  or  adapted  from  the  cited 
Jorgensen-Hoffer  report. 
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and  feedback  requirement  implied  by  the  tasks,  there  is  a  medium-method  combina¬ 
tion  in  the  training  program  to  meet  the  need.  But  because  of  costs  and  other 
constraints  such  an  ideal  training  program  cannot  be  achieved.  Rather,  as  the 
result  of  designing  a  training  program  within  real-world  constraints  something 
less  than  an  ideal  program  is  actually  achieved.  The  difference  is  expressed 
by  an  efficiency  ratio  that  will  be  explained  in  Section  IIIC. 


The  task  variables  you  will  deal  with  fall  within  three  classes: 
stimuli  or  cues,  response  or  answering  action  to  the  stimulus,  and  feedback  or 
information  to  the  operator  concerning  results  of  his  action.  In  addition, 
there  are  method  and  media  variables.  Procedures  for  using  these  variables 
to  predict  or  develop  training  programs  are  discussed  in  the  context  of  the 
following  example. 


a.  Start  with  a  task  description.  If  there  is  none,  you  will  have 
to  generate  the  task  list  ( see  Section  IIIA ,  above) .  For  illustrative  pur¬ 
poses,  we  will  use  the  following  task  description: 


Task: 


Perform  subsystem  equipment  failure  reconfiguration  using 
DTH-9- 1430-650-10,  Chapter  2,  under  task  condiT^ion  levels  1  and  2,  within 
three  minutes. 


1 .  Detect  console  malfunction  by  observing  Plan  Position 
Indicator  (PPI)  displays. 

2.  Upon  detection  of  malfunction,  use  keyboard  printer  unit  (KPU) 
to  select  alternate  console. 

3.  Analyze  keyboard  "TMON”  printouts  to  verify  correct  operation. 

b.  Compare  the  task  description  to  the  variables  listed  under  "Media 
Related  Variables  —  Stituili  Characteristics,"  Annex  A,  Appendix  1.  Note  that 
comparison  of  the  task  and  variables  list  1-7,  shows  only  variable  1  to  be  ap¬ 
plicable.  Because  variables  2-7  do  not  apply,  they  can  be  eliminated,  along 
with  variables  25-30,  which  aoply  to  audio  stimuli  only.  Variables  8-24  and 
3 ’-39  must  now  be  screened  for  their  applicability  to  the  task  description.  If 
a  variable  is  shown  to  be  applicable  it  is  scored  with  a  1 ,  and  if  it  is  shown 
to  bo  non-applicaole ,  it  is  scored  with  a  0.  These  scores  are  kept  on  separate 
coding  sljeets,  like  the  one  shown  in  Figure  III-4. 

The  example  task  description  involves  observation  of  PPI  displays. 
Normally,  the  "Visual  Forms, "  variables  8-13,  which  can  be  presented  on  PPI 
displays,  include  alphanuneric,  symbolic,  and  graphic  material  (8,  9,  and  10), 
but  do  not  include  other  forms,  such  as  pictorial,  solid  object,  or  environmental 
scenes  (11,  12,  and  13).  Variables  8,  9,  and  10  would  each  be  coded  as  i  on  the 
coding  sheet,  while  variaoies  11,  12,  and  13  would  be  coded  as  0.  A  similar 
procedure  is  used  for  ail  applicable  variables.  For  Lnstance,  stimuli  found  on 
PPI  displays  may  change  at  any  time,  and  are,  therefo.’'e,  not  static  (31).  Stim¬ 
uli  presented  on  the  radar  displays  are  also  quite  random  (33),  rather  than 
ordered  (32).  Therefore,  variables  31  and  32  would  be  scored  wit.h  a  0  arid  33 
would  be  scored  wi'^.h  a  Once  the  entire  list  of  of  applicable  variables  has 
been  screened  and  scored  or  the  coding  sheet,  using  the  above  procedure,  the 


task  will  have  been  described  in  terms  of  the  variables  for  the  stimulus  situa¬ 
tion.  (See  the  first  row  of  the  Sample  Coding  Sheet,  Flwe  III-4  for  the  ap¬ 
plicable  variables  for  this  sample  task.) 

c.  Now  compare  the  task  description  to  the  variables  listed  under 
”Media  Related  Variables  ~  Response  Characteristics”  in  Appendix  2  to  Annex  A. 
Only  the  physical  properties  of  tne  equipment  which  receive  the  operator's  re¬ 
sponse  to  the  stimulus  are  considered.  In  this  example,  note  that  the  operator’s 
response  is  an  overt  one,  i.e,,  visible,  and  involves  the  manipulation  of  but¬ 
tons  on  the  KPU .  Thus ,  variables  1 ,  2 ,  4 ,  and  5  are  coded  as  a  0 ,  and  3  is 
coded  as  a  1  on  the  coding  sheet.  Likewise,  the  responses  are  not  major  physical 
movements  and  are  coded  as  weak  intensity  responses  (6).  The  trainee  is  manipu¬ 
lating  equipment,  the  responses  he  produces  will  be  dynamic-ordered  (9)  and  the 
equipment  must  be  capable  of  accepting  such  a  response.  Similarly,  the  respcxise 
rate  would  probably  be  fast  (12),  the  nvnber  of  response  channels,  limited  (13), 
and  the  response  distribution,  individual  (15).  (See  the  second  row  of  the 
Sample  Coding  Sheet  for  the  applicable  variables  for  this  sample  task.) 

d.  Now  code  the  task  in  the  same  manner  for  feedback  variables.  Ap¬ 
pendix  3  to  Annex  A.  In  this  example,  the  mediun  of  information  is  written 
form  (3).  The  source  of  feedback  is  intrinsic  (not  visible  from  the  outside) 
(10),  the  type  of  feedback  is  both  response  consequences  (14)  and  system  status 
(15),  and  the  feedback  distribution  is  again  individual  (16).  (See  third  row 
of  the  Sample  Coding  Sheet  for  the  applicable  variables  for  this  sample  task.) 

e.  After  you  have  recorded  the  task  information  in  terms  of  variables 
directly  related  to  equipment  choice,  one  other  evaluation  is  required.  The 
group  of  tasks  must  now  be  recoded  in  terms  of  fianctional  context  (expected 
operational  environment)  variables  for  method.  Because  this  example  only  deals 
with  a  single  task,  this  coding  is  somewhat  artificial,  since  normally  a  method 
would  not  be  chosen  for  a  single  task  situation,  but  rather  tVie  overall  func¬ 
tional  context  within  which  a  cluster  of  related  tasks  would  be  performed.  The 
method  variables  are  found  in  Appendix  4. 

Coding  the  task  for  method  requires  the  same  logic  used  to  code  the 
media.  For  this  sample  task,  the  role  performed  by  the  operator  in  the  real 
environment  is  individual  performance  (3).  The  functions  performed  in  the  role 
are  primarily  mental  in  terms  of  analyzing  the  "TMCN”  printouts  (4),  physical  in 
terms  of  selecting  an  alternate  console  (5),  and  perceptual  in  terms  of  observing 
PPI  displays  (6).  The  function  is  basically  stable  (9),  since  it  does  not  change 
often.  The  impact  of  the  physical  context  (10)  and  psychological  context  (12)  is 
low.  (See  the  fourth  row  of  the  Sample  C'^ing  Sheet  for  the  applicable  variables 
for  this  sample  task.) 

f.  Appendix  5  is  a  listing  with  complete  descriptions  of  38  items  of 
training  equipmt-nt  and  materials  each  of  which  is  ntinbered.  Figure  III-5  is  a 
matrix  which  shews  the  nunbers  of  the  item  of  training  equipment  and  materials 
across  the  top  versus  the  39  stimuli  variables  connected  with  media  in  the  left 
column.  A  ”1”  has  been  entered  in  eac.h  cell  where  that  particular  medium  matches 
the  corresponding  stimulus.  You  are  now  ready  to  begin  the  medium  selection 
process. 

('}  DetermLne  fi-om  Figure  III-i,  Coding  Sheet,  vhicn  of  the  num¬ 
bered  stimulus  variables  you  have  decided  are  relevant  to  the  task  lor  g.^'ouping 
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Figure  II 1-5.  Tr.ilnii  Equli-.iient  and  Materials  versus  Stimuli  Variables 
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A  =  Audio  Only  V  =  Visual  Only 

Trninlii};  and  Matei  ...Is  Versus  Stimuli  Variables  (continued) 


of  similar  tasks).  In  this  example,  they  were  1,  8  ,  9,  10,  14,  18  ,  22  ,  24  ,  33, 
35,  36,  and  38  (see  paragraph  b  above).  These  rows  have  beer  shaded  on  Figure 
III-5  for  convenience.  The  cells  in  these  shaded  rows  are  the  only  ones  you 
are  concerned  with  in  this  example. 

(2)  For  each  colutin,  sum  the  cells  of  concern  in  which  there  is 
a  "1."  These  sums  are  shown  at  (a)  at  the  bottom  of  matrix.  These  sums  re¬ 
flect  how  well  each  device  fits  the  conditions  of  the  stimuli  variables  of  the 
task.*  The  pieces  of  equipment  showing  the  "best  fit"  are  Ceirrel  (19),  dial 
access  information  retrieval  system  -  audio/ visual  (20),  and  computer  (32). 
Because  only  a  single  task  has  been  used  in  this  example,  more  than  one  piece 
of  equipment  shows  a  "best  fit."  However,  if  more  tasks  had  been  used,  the 
selection  process  would  have  narrowed  down  the  number  of  "best  fit"  pieces  of 
equipment.  If  there  are  a  number  of  "best  fit"  pieces  of  equipment,  however, 
the  piece  that  coats  the  least  would  be  the  one  selected.  Complete  descriptions 
of  the  three  devices  selected  can  be  found  in  Apf’endix  5. 

(3)  Figure  III-6  is  the  corresponding  matrix  for  the  response 
variables  showing  across  the  top  the  nunber  of  the  38  items  of  training  equip¬ 
ment  and  materials  versus  the  nunber  of  the  16  response  variables  in  the  left 
colunn.  As  with  the  stimulus  vai'iables,  determine  from  Figure  III-4,  Coding 
Sheet,  which  of  the  nunbered  response  variables  you  have  decided  are  relevant 
to  the  task  (or  taak  grouping).  In  the  example,  these  are  3»  6,  9,  12,  13, 
and  15  (see  paragrapti  b  above).  These  rows  have  been  shaded  on  P'igure  III-6. 

The  re.sult  of  the  sunning  of  the  appropriate  cells  is  shown  in  row  (b)  at  the 
bottom  of  the  matrix.*  The  largest  value  in  the  row  is  6,  which  corresponds 
to  carrels  (19),  demonstrators  (33),  mock-up  and  panel  (34),  and  operational 
equipment  (35).  The  description  for  each  device  can  again  be  found  in  Appendix 
5. 


(4)  Finally,  perform  the  same  operations  for  the  feedback  vari¬ 
ables.  Figure  III-7  is  the  matrix  with  t.he  39  items  of  traLning  equipment  a.nd 
materials  across  the  top  and  the  1?  feedback  variables  in  the  left  colunn.  The 
feedback  variables  of  interest  (from  Figure  III-4,  Coding  Sheet)  were  determined 
to  be  3,  10,  14,  15,  and  16  (shaded  in  Figure  III-7).  The  result  of  sunning  is 
shown  in  row  (c)  at  the  bottom  of  the  matrix.*  The  "best  fit"  media  are  com¬ 
puter  (32)  and  operational  eqid,pment  (35). 

(i)  Nc--  the  method  can  be  selected.  Figure  III-8  is  a  matrix 
with  23  methods  across  the  top  ar.d  13  functional  context  variables  in  the  left 
column.  From  Figure  III-4,  you  have  determineo  for  this  example  tl'iat  the  furic- 
tional  context  variables  3,  4,  5,  6,  9,  ’0,  and  ’2  are  relevant  to  this  task. 

The  result.^  of  suraning  the  appropriate  cells  for  the  example  ar'e  in  row  (d)  at 


*If  you  c*.".  weig.ht  t.he  difference  Ln  impcrtcr.cc  of  the  atirwli  variables,  then 
you  must  multiply  each  "1"  in  those  cells  of  interest  by  your  appixspriate 
weighting  before  suenLng  each  colunn. 

*Again,  as  for  the  stimiilus  variables  matrix,  if  you  cari  weight  the  importance 
of  these  response  variables,  ycu  would  multiply  each  applicable  "1"  ny  the 
corresponding  weight. 
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Figure  ITI-8.  Method  Selection  Matrix 


the  bottom  of  the  matrix.*  The  method  selected  is  tutoring  (13).  A  description 
of  each  method  is  at  Appendix  6. 

g.  For  this  example,  the  complete  package  would  probably  consist  of 
a  carrel  for  a  stimulus  presentation  device,  carrel  for  a  response  acceptance 
device,  and  a  computer  for  a  feedback  evaluation  device.  The  "best  fit"  method 
would  be  tutoring.  If  "instructor"  had  been  included  as  a  type  of  media  in  the 
selection  matrices  for  media,  the  probability  that  an  instructor  would  have  been 
chosen  over  a  computer  for  feedback  evaluation  is  high,  since  he/she  probably 
costs  less  and  is  much  more  flexible.  In  addition,  an  instructor  would  fit  well 
with  the  tutorial  method  selected. 

Only  one  task  at  a  tima  has  be«i  considered  in  the  selection  of 
method  and  stimulus,  response,  and  feedback  equipment.  If  several  tasks  had 
been  used,  there  would  have  been  three  vectors  of  suras  for  each  media  subprocess. 
Each  one  would  have  been  grouped  in  a  matrix  and  would  have  been  subjected  to 
the  procedure  that  generates  the  effieiaicy  ratios  to  be  covered  in  paragraph  C. 

A  number  of  equipment  choices  would  have  th^js  been  generated,  but  when  a  small 
nunber  of  related  tasks  is  considered,  the  result  is  a  single  piece  of  equipment. 


2.  TECEP  (Braby  et  al. ,  A  Technique  for  Choosing  Cost-Effective 
Instructional  Delivery  Systems,  TA^fi  Report  No.  16,  19'/5) 


Of  all  available  analytical  methods  with  potential  applications  to 
CTEA,  this  one  appears  to  be  the  one  most  consistent  with  current  ISD  procedures 
(TRADOC  Pamphlet  350-30).  The  ISD  procedures,  in  Block  III.1,  employ  the  same 
learning  guidelines  and  algorithms  (for  twelve  types  of  training  objectives)  on 
which  this  method  is  based.  The  TAEG  method  is  called  Training  Effectiveness. 
Cost  Effectiveness  Prediction  technique  (TECEP) ,  and  it  is  intended  for  use 
during  the  conceptual  phase  of  training  program  development.* 


The  TECEP  technique  begins  with  a  list  of  training  objectives.  If 
these  are  not  available,  they  must  be  generated.  Each  training  objective  in 
the  proposed  training  system  is  matched  with  the  category  of  learning  or  learn¬ 
ing  algorithm  of  which  twelve  are  given.  These  are  reproduced  in  Table  B-1-1 
of  Appendix  1  to  Annex  B  with  the  characteristics  of  training  objectives  that 
can  be  accomplished  with  them. 


a.  Make  a  tentative  classification  by  checking  the  learning  objective 
against  the  information  given  for  each  category  and  decide  in  which  it  fits 


•See  previous  notes  for  stimulus  and  response  variables  regardiiig  weighting. 
This  is  applicable  here,  also. 

•The  procedures  herein  have  been  taken  from  or  adapted  from: 


a.  Braby  et  al..  Trai.ning  Analysis  and  Evaluation  Group,  A  Tectvsique  for 
Choosing  Cost-Effective  Instructional  Delivery  Systems,  TAEG  Report  No.  16, 


Systems  Development.  Phase  III,  Develop,  1  August  mb  (much  of  which  was 
a^pted  from  TAEG  manuscripts). 
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best.  Compare  the  characteristics  of  the  training  objective  with  the  action 
verbs,  behavioral  attributes,  and  examples  of  objectives  as  listed  in  the 
table. 

If  you  have  difficulty  fitting  a  learning  objective  into  a  single  cate¬ 
gory  because  it  seems  to  fit  equally  well  in  several,  the  learning  objective 
may  not  be  specific  or  clear,  the  action  required  may  be  two  or  more  objectives 
or  it  may  have  other  faults.  If  creating  two  or  more  objectives  is  not  feasi¬ 
ble,  decide  what  in  the  objective  will  require  the  most  instruction.  Place 
the  objective  in  that  category. 

EXAMPLE 

The  learning  objective  might  be  "Paint  barracks  when 
painting  is  needed."  Applying  the  paint  is  a  repetitive 
mechanical  skill,  and  the  objective  fits  "performing  gross 
motor  skills."  However,  knowing  when  painting  is  needed 
requires  choosing  a  course  of  action  based  on  applying 
known  rules,  and  the  objective  also  fits  "rule  learning  and 
using."  Divide  the  original  objective  into  two  new  ones: 

"Paint  the  barracks,"  and  "Identify  that  barracks  needs 
painting." 

Group  the  training  objectives  into  sets  that  are  classified  alike. 

b.  Appendix  2  to  Annex  B  contains  an  Instructional  Delivery  System 
Chart  for  each  category  of  learning  or  learning  algorithm  discussed  in  Appendix 
1 .  For  group  or  set  of  training  objectives: 

(1)  Select  the  Instructional  Delivery  System  Chart  corresponding 
to  the  learning  algorithms  of  that  set.  The  chart  for  the  algorithm.  Recalling 
Prccedures  and  Positioning  Movement,  is  provided  as  Figure  III-9.  Note  that  the 
colvmns  head«3d  Alternative  Instructional  Delivery  Systems  are  divided  into  two 
sections;  i.e.,  those  permitting  the  full  use  of  the  algorithm  and  those  not 
permitting  full  use.  The  latter  group  includes  some  existing  or  traditional 
practices  that  are  considered  to  be  less  powerful  or  efficient  than  those  en¬ 
abling  the  full  use  of  the  algorithm.  The  analyst  may  wish  to  add  additional 
approaches  to  either  side  of  the  cnai  t . 

(2)  Each  of  the  learning  activities  now  must  be  translated  into 
applicable  stimulus  criteria.  The  possible  stimulus  criteria  are  listed  in  the 
left  coiunn  of  the  selection  ch.art.  If  the  activity  involves  sound  alone,  con¬ 
sider  the  choices  ijnder  audio  sticuli.  If  the  activity  involves  visual  stimuli, 
specify  which  visuals  are  needed.  For  each  stimulus  criteria  applicable  tc  the 
selected  le<uning  activities,  put  a  c.neck  mark  after  the  appropriate  stimulus 
criteria  on  the  worksheet.  These  are  very  important  because  they  will  be  the 
basis  for  selecting  the  pool  of  me.ia  mixes.  Requirec  stimulus  criteria  are 
those  basic  qualities  or  capabilities  of  a  mediiia  (such,  as  visual  images,  motion, 
color,  and  sound)  tnat  are  required  to  carry  out  the  irstent  of  a  learning  acti¬ 
vity.  These  requireu  stimulus  criteria  can  be  specified  oy  tv'pes  of  stL-nul<.s 
inherent  in  the  learning  activity,  the  student  response,  and  performance  feed¬ 
back  dema.nds  of  t.he  learning  activity. 
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A  media  alternative  is  a  form  of  instructional  material  that  con¬ 
tains  the  stimulus  criterion  required  by  a  specific  learning  activity.  Identi¬ 
fication  of  media  alternatives  is  done  by  selecting  those  media  within  the 
learning  category  that  meet  the  required  stimulus  criteria.  These  become  candi¬ 
dates  for  possible  use  as  part  of  the  final  delivery  system. 

(3)  Along  the  left  side  of  the  chart  also  are  listed  requirements 
of  the  training  setting,  and  certain  administrative  and  budgetary  constraints 
unique  to  the  specific  instructional  program. 

A  blank  colLCin,  with  the  heading  "Directions"  appears  on  the  chart 
immediately  to  the  right  of  the  criteria  list.  To  use  the  chart,  place  a  light 
check  in  pencil  in  those  cells  designating  criteria  that  must  be  satisfied  by 
the  delivery  system.  Then  determine  vrihich  delivery  systems  meet  all  these 
special  criteria. 

This  part  of  the  procedure  has  been  carried  out  in  Figure  III-9. 
Note  the  criteria  that  were  checked  as  being  essential  to  the  training  program 
for  this  objective.  Also  note  that  only  the  circled  delivery  systems  met  all 
the  special  criteria.  Two  permit  the  full  algorithm  to  be  used,  and  one  does 
not  support  the  full  use  of  the  algorithm.  The  two  tentatively  recoomended 
alternatives  are: 

(a)  Microfiche  with  or  without  Photo  or  Operable  Mock-up. 

(b)  Prograimed  Text-Branching 

c.  Each  it«n  remaining  in  the  list  of  media  should  be  evaluated  in 
terms  of  the  practicality  of  its  use  in  the  specific  training  system.  Reject 
those  media  that  are  impractical.  The  media  types  that  remain  are  considered 
to  oe  candidates  for  use  in  the  proposed  system,  and  will  be  subjected  to  a  cost 
analysis.  Some  of  the  factors  that  may  be  important  in  rejecting  media  types 
are: 


(1)  Marginal  Technical  Solutions:  The  learning  guidelines  cannot 
be  easily  carried  out  with  the  mediun. 

(2)  State-0 f- the- Art :  The  basic  medium  is  under  development  or 
test  and  may  not  be  available  for  practical  application  by  the  time  it  is 
required. 


(3)  Size  of  SystOT:  Some  media  are  useful  within  large  training 
programs,  others  are  suite<J  only  for  small  programs,  and  therefore  may  not  be 
suited  to  the  size  program  being  considered. 

(4)  Interface  with  Existing  Program:  Many  new  courses  must  be 
designed  to  fit  into  existing  programs,  which  places  constraints  on  the  new 
courses;  e.g.,  equipment  on  hand,  available  classrooms,  scheduling  practices, 

etc. 


(5)  Time  to  Produce  Media:  M, lia  which  require  long  lead  times 
for  development  may  not  be  useful  when  .scheduled  read/- for- training  dates  do 
not  allow  a  long  develcpmer.t  cycle. 
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(6)  Budget  Cycle  Constraints:  Wnile  the  application  of  some  of 
the  powerful  training  approaches,  such  as  CCTV  (closed  circuit  television), 
may  result  in  low  costs  per  student  graduate,  the  irJ.tial  investraait  is  sub¬ 
stantial.  Unless  these  resources  appear  in  existing  budgets,  the  application 
of  these  techniques  to  an  iinnediate  problem  is  not  feasible. 

(7)  Adoption  of  Innovations:  Project  team  members  frequently 
resist  innovations.  If  the  proposed  media  is  significantly  different  from  ex¬ 
isting  techniques,  either  adequate  resources  must  be  focused  upcn  gaining  accep¬ 
tance  for  the  innovation,  or  a  more  traditional  approach  must  be  selected. 

(8)  Courseware  Development;  If  the  courseware  is  to  be  locally 
developed,  skilled  personnel,  equipment,  time,  and  dollars  must  be  available. 

(9)  High  Cost  Alternatives;  The  projected  life  cycle  cost  of  a 
media  approach  may  be  significantly  higher  than  other  equally  useful  alterna¬ 
tives.  Reject  high  cost  alternatives. 

(10)  Le^ing  Style  of  Trainees:  If  trainee  has  low  reading 
ability  or  would  be  limited  in  his  ability  to  use  certain  kinds  of  media,  then 
reject  these  media  as  inappropriate. 

(11)  Other  Constraints:  A  variety  of  other  practical  factors 
should  be  considered;  e.g.,  cotmand  policy  and  existing  investment  in  production 
facilities. 


In  the  case  of  the  sample  problem  ( Figure  III-9 ) ,  the  approach  re¬ 
quiring  the  use  of  progranmed  text-branching  is  found  to  be  a  practical  solution 
with  some  risk  associated  with  "learning  style  of  trainees".  No  other  problems 
were  identified  by  considering  each  criterion  in  the  practicality  test.  During 
consideration  of  the  microfiche- based  approach,  however,  a  low  degree  of  risk 
was  identified  for  two  items.  The  first  low  risk  area  concerned  test  item  Num¬ 
ber  2,  the  "state-of-the-art."  Studies  involving  the  use  of  color  microfiche 
in  procedure-following  training  have  not  been  conducted  within  the  Department 
of  Defense.  However,  applications  in  industry  have  been  successful.  Some  risk, 
however,  is  associated  with  the  initial  applications  of  colored  microfiche  in 
the  military  environment.  The  second  low  risk  area  concerned  test  item  Number 
8,  "courseware  development."  It  is  assumed  that  the  team  developing  courseware 
will  have  no  experience  in  developing  microfiche-based  courseware.  This  lack  of 
experience  is  not  considered  to  be  a  serious  problem.  Skills  required  would  be 
similar  to  those  used  in  writing  progranmed  texts  and  makj.ng  slide  sets.  The 
reproduction  of  the  color  microfiche  would  be  accomplished  oy  a  coinnercial 
laboratory. 


Both  Instructional  delivery  system.^  survived  the  practicality  test 
and  are  considered  to  be  candidates  for  use  in  ..he  proposed  training  system. 

3.  DIVAD  Gun 

Given  a  "generic"  task  list  as  generated  in  paragraph  A1  aoove  (page 
III-1),  you  must  again  rely  on  your  subject  matter  expertise  and  good  judgment 
or  find  an  SME  to  help  you  develop  training  alternatives.  For  example,  in  the 
DIVAD  Gun  CTEA,  the  analyst  was  an  SME  and  had  some  familiarity  with  the  DIVAD 
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Gun  and  training  device  configurations  and  capabilities.  He  formulated  the 
following  three  alternatives: 

a.  Training  conducted  with  operational  equipment  only. 

b.  Training  conducted  with  reduced  operational  equipment 
augmented  by  the  classroom  trainer. 

c.  Training  conducted  with  further  reduced  operational 
equipment  augmented  by  both  the  classroom  trainer  and 
the  maintenance  trainer. 

As  with  the  generation  of  the  "generic”  task  list,  this  method  is  a 
last  resort  when  "something  is  better  than  nothing"  and  is  based  totally  on 
previous  experience. 

4.  Analogous  Task  Method 

Having  generated  a  task  list  by  any  of  the  methods  in  A  above  (see 
pages  III-1  to  III-6),  you  must  now  locate  a  training  yardstick  against  which  a 
proposed  training  plan  can  be  evaluated.  The  yardstick  should  provide  you  with 
the  ability  to  predict  the  level  of  success  of  the  training  plan,  to  diagnose 
those  parts  likely  to  be  problematic,  and  to  prescribe  alternative  components 
for  these  parts.  Since  training  will  be  given  on  a  task  by  task  basis,  the  yard¬ 
stick  must  be  in  reality  many  yardsticks,  one  for  each  task.  To  fulfill  the 
three  purposes  of  prediction,  diagnosis,  and  prescription,  detailed  training 
information  is  required. 

One  likely  source  of  such  information  is  the  training  being  done  for 
tasks  on  fielded  systems.  The  training  on  a  fielded  system  has  usually  been 
used,  tested,  and  modified.  It  c.in  therefore  serve  as  a  working  model  of  trai.n- 
ing  for  the  system  in  development  and  as  a  source  of  evaluative  data  on  the 
effectiveness  of  training.  The  central  difficulty  in  using  this  training  infor¬ 
mation  is  the  necessity  to  decide  vrtiich  task  on  one  or  more  fielded  systems  roost 
closely  approximates  the  task  whose  training  is  being  predicted.  The  problem  is 
two-fold.  First,  you  must  define  the  criteria  by  which  you  will  decide  whether 
a  fielded  task  is  similar  or  analogous.  Second  you  must  locate  analogous  tasks. 
Remember  that  your  concern,  especially  in  the  early  stages  of  development,  should 
be  focused  on  the  form  of  training  (the  training  approach,  the  training  resources 
needed,  etc.)  rather  than  the  content  of  training.  Tasks  which  are  sufficiently 
different  so  that  the  content  of  the  training  is  of  little  use  may  still  provide 
valuable  information  about  the  appropriate  form  of  training. 

a.  Task  Classification 

(!)  Classify  the  target  task  by: 

o  the  action  verb  in  the  task  description, 

o  the  body  of  knowledge  the  soldier  must  understand  as 
general  background  to  task  performance, 

o  the  stimuli  provided  by  the  equipment  (or  external 
source)  to  initiate  the  task. 


o  the  response  made  to  the  stimuli, 

0  the  feedback  provided  to  indicate  proper  or  improper 
performance  of  the  task. 

(2)  Determine  the  task  type  by  the  action  verb  and  the  knowledge 
context  for  each  task.  The  knowledge  or  task  context  is  the  general  nature  of 
the  equipment  and  the  action  performed  with  it.  For  some  tasks,  the  context 
will  be  explicit  in  the  task  verb.  For  example,  "Fly”  is  a  task  performed  with 
aircraft  (or  missiles).  For  other  tasks,  the  action  occurs  in  a  variety  of  con¬ 
texts.  Therefore,  you  must  derive  the  context  from  the  task  description  as  a 
whole.  "Troubleshoot,"  for  example,  is  an  action  performed  with  electrical, 
electronic,  automotive,  and  mechanical  equipment,  among  others.  The  subtasks 
and  task  elements  of  "Troubleshoot"  in  these  various  contexts  will  be  very  dif¬ 
ferent.  Not  all  tasks  have  a  specific  context.  You  may  find  tasks  for  vMch  a 
context  is  not  important.  That  is,  the  task  requires  the  same  action  regardless 
of  the  nature  of  the  equipment  on  which  it  is  performed. 

The  types  of  actions  fall  into  15  major  categories: 

o  1 .  Selecting  and  using  roles 
o  2.  Making  decisions 
0  3.  Solving  problems 

0  4 .  Monitoring 

0  5.  Classifying  perceptual,  non-rgraphic  signals 

0  6  -.  Identifying  graphic  symbols 

0  7-  Communicating  by  voice^  2 

o  6.  Coramunicat.’ -ig  by  writing  or  typing‘s  2 

o  9.  Communicating  non-verbally  (signaling)*^ 

0  10.  Following  proced'ures 
o  11.  Positioning  movements 
0  12.  Discrete  regulatory  movements 
o  13.  Continuous  regulatory  movements 
0  14.  Performing  complex  skills 
o  15.  Gross  motor  movement 

Compare  the  action  verb  with  those  in  the  task  verb  list 
(Appe-idix  1  of  Aimex  C).  The  list  gives  the  task  type  to  which  each  verb  mean¬ 
ing  has  been  assigned.  If  the  verb  does  not  appear  in  the  task  verb  list,  com¬ 
pare  the  verb  with  the  descriptions  and  examples  of  each  type  that  appear  in 


^Many  action  verbs  indicating  the  process  of  classifying  are  independent  of 
the  object  classified.  These  verbs  are  appropriate  for  both  categories  5  and 
6.  To  classify  a  particular  task  when  these  verbs  are  used,  you  must  also 
determi.ne  the  nature  of  the  classified  object. 

2 

Many  action  verbs  i.ndicate  the  process  of  .in  format  ion  transfer  without  re¬ 
ference  to  the  mea.ns  of  transfer.  These  verbs  are  appropriate  to  both 
categories  7  and  0.  Tliiese  verbs  ray  also  be  appropriate  to  category  9  al¬ 
though  signaling  is  not  usually  appr  ooriate  to  t:.e  ccntrunication  of  large 
quantities  of  information  or  fi.ne  detail,  Tc  classify  a  particular  task 
when  these  verbs  ai*e  used,  you  must  also  acterm:ne  the  coor.unication  process. 


the  synonym  list  (Appendix  2  to  Annex  C).  The  verb  may  be  an  unlisted  synonym 
for  one  of  the  verbs  in  the  synonym  list.  If  not,  assign  the  verb  to  that  cate-’ 
gory  which  most  closely  describes  it. 

(3)  Determine  the  type  of  initiating  cue  or  stimulus.  The  ini¬ 
tiating  cue  which  indicates  that  a  task  should  begin  can  be  classified  as  vis¬ 
ual,  auditory,  tactile,  body  motion,  limb  motion,  olfactory,  or  gustatory. 

These  are  defined  in  Table  III-1 .  The  characteristics  of  the  cue  can  be  classi¬ 
fied  along  several  dimensions.  Some  of  Uiese  dimensions  are  general.  That  is, 
cues  in  all  of  the  categories  can  be  classified  along  these  dimensions.  The 
dimensions,  defined  in  Table  III-2  are  the  likelihood  that  the  cue  will  occur 
during  a  mission,  the  rate  at  vrtiich  the  cue  will  occur,  the  intensity  or  contrast 
of  the  cue  with  respect  to  the  background,  and  the  presence  of  other  cues  com¬ 
peting  for  attention.  In  addition,  there  are  dimensions  specific  to  cues  in 
the  visual  and  auditory  categories.  Visual  cues  are  classified  by  their  form, 
•movement,  and  color;  auditory  cues,  by  their  pattern,  range,  and  pitcli.  The 
visual  dimensions  are  defined  in  Table  III-3  and  the  auditory  dimensions,  in 
Table  III-4. 


The  initiating  cue  for  a  task  may  have  components  in  more 
than  one  category.  However,  each  component  will  have  only  one  characteristic 
value  along  each  of  the  dimensions.  For  example,  the  cue  niay  have  visual  (1) 
and  tactile  (3)  components.  The  tactile  component  may  be  likely  to  occur 
(0,1.2),  but  only  once  (0.2.1),  it  may  be  high  in  contrast  (0.3.2)  and  occur 
when  other  cues  do  not  (0.4.1).  The  visual  component  may  be  low  in  contrast 
(0.3.1)  with  the  other  three  characteristics  the  same  as  for  the  tactile  com¬ 
ponent.  In  addition,  the  visual  component  may  be  alphanimeric  (1.5.2),  still 
(1.6.1),  and  black  and  white  (1.7.1).  Note  that  the  visual  component  can  be 
low  in  contrast  vriiile  the  tactile  component  is  high,  but  the  visual  component 
cannot  be  both  low  and  high  in  contrast  itself. 

(4)  Determine  the  type  of  response  to  the  stimulus.  The  response 
completing  the  cask  can  be  classified  as  verbal,  written,  manipulative  or  exer- 
tive  ( see  Table  III-5 ) .  The  responses  in  all  categories  can  be  assessed  as  to 
the  pattern  and  required  rate  of  response,  the  effort  necessary  to  make  the  re¬ 
sponse,  the  presence  of  competing  responses,  and  the  allowable  flexibility  of 
response.  The  specific  values  distinguished  along  these  dimensions  are  defined 
in  Table  III -6.  As  with  the  cues,  the  responses  can  have  components  in  more 
than  one  category  but  each  component  will  have  only  one  characteristic  value 
along  each  of  the  dimensions. 

Note  ttat  to  classify  a  response  as  e'  ..reive  aces  not  mean 
that  the  amount  of  effort  expended  is  high  nor  must  a  manipulative  action  be 
low  in  effort.  Pushing  a  cart  (exertive),  for  example,  may  require  little  ef¬ 
fort  while  positioning  a  lever  (manipulative)  may  require  much  effort.  You  may 
have  difficulty  classifying  responses  in  which  a  force  is  applied  to  position 
an  object.  It  may  be  helpful  to  focus  on  the  basic  r.ature  of  the  response.  If 
the  response  is  concerned  with  movement,  then  the  response  is  exertive;  if  the 
response  is  concerned  with  final  position  and  the  movement  is  secondary,  then 
the  response  is  manipulative. 


TABLE  III-1 


Categories  of  Initiating  Cues 


1 .  Visual  cues  -  signals  received  through  the  sense  of  sight. 

2.  Auditory  cues  -  signals  received  through  the  sense  of  hearing. 

3.  Tactile  cues  -  signals  received  through  the  soise  of  touch,  including  cues 
from  the  texture,  size,  or  shape  of  an  object  and  from  vibration  on  the 
^n. 

4.  Body  Motion  cues  -  signals  received  through  sense  of  equilibrium,  including 
cues  from  external  forces  that  cause  the  body  to  roll,  pitch,  yaw,  heave, 
sway  and/or  surge. 

5.  Limb  Motion  cues  -  signals  received  through  the  proprioceptive  sense,  such 

as  are  felt  when  the  arms,  legs,  fingers,  etc.,  are  moved. 

b.  Olfactory  cues  -  signals  received  through  the  sense  of  smell. 

7.  Gustatory  cues  -  signals  received  through  the  sense  of  taste. 


TABLE  III-2 


General  Dimensions  of  Cue  Characteristics 


0.1  Cue  Likelihood 

0.1.1  Unlikely  Cue  is  not  expected  by  the  operator  or  maintenance 

personnel  because  of  low  likelihood  or  irregular 
pattern  of  occurrence. 

0.1.2  Likely  Cue  is  expected  by  the  operator  or  maintenance 

personnel  because  of  previously  occurring  cues  or 
a  regular,  cyclical  occurrence  of  the  same  cue. 


0.2  Cue  Occurrence  Rate 

0.2.1  Single  A  single  cue  occurs  in  the  course  of  a  mission 

(assuming  that  a  cue  does  occur) . 

0.2.2  Low  Rate  A  slow  or  low  rate  of  occurrence  of  the  cues  through 

the  course  of  the  mission. 

0.2.3  High  Rate  A  fast  or  high  rate  of  occurrence  of  the  cues  through 

the  course  of  the  mission. 


0.3  Cue  Intensity  or  Contrast 

0.3.1  Lew  Cue  is  of  low  intensity  and  low  contrast,  i.e.,  a  sig¬ 

nal  which  blends  into  the  background  ncise  of  that 
sense  and  is  therefore  difficult  to  distinguish  or 
detect . 

0.3-2  High  Cue  is  of  high  intensity  or  a  cue  of  high  contrast, 

i.e.,  a  signal  which  stands  out  from  the  background 
by  reason  of  higher  or  lower  intensity,  and  is  there¬ 
fore  easy  to  distinguish. 


O.U  Cue  Competition 

0.4.1  Low  Cue  occurs  when  few  other  cues  or  actions  are  cooh 

peting  for  the  attention  of  the  operator  or  rai.';- 
ter.ance  personnel. 

0.4.2  High  Cue  occurs  when  ether  cues  or  actions  have  the 

attention  of  the  operator  or  maintenance  personnel 
and  therefore  the  cue  may  be  missed  or  reaction  to 
the  cue  may  be  delayeo. 
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TABLE  III-3 

Dimensions  of  Visual  Cue  Characteristics 


1 .5  Visual  Form 
1.5.1  Spot 


1.5.2  Alphanuneric 

1.5.3  Symbolic 

1.5.4  Graphic 


1 .5 .5  Pictorial 


1.5.6  Solid  Object 

1.5.7  Ambient 
Light 


1.6  Visual  Movement 

1.6.1  Still  Static  visual  images  such  as  still  photographs,  drawings,  or 

printed  pages. 

1.6.2  Limited  Partially  static  visual  images  with  elements  that  move  over 

Movement  a  limited  portion  of  the  image. 

1.6.3  Cyclic  Visual  images  in  which  the  elements  move  over  the  full  ex- 

Movement  tent  of  the  image  but  in  a  fixed,  repetitive  sequence. 

1.6.4  Full  Visual  images  in  v^ch  all  elements  move  over  the  full  ex- 

Moveoent  tent  of  the  image  without  restriction. 


1 .7  Visual  Color 

1.7.1  Black  and  Visual  images  composed  of  black  and  white  elements,  such  as 
White  printed  pages  or  line  drawings  (images  with  dichotomous 

colors  such  as  brown  and  beige  printed  pages  or  g.f'een  and 
black  CRT  displays  are  classified  as  black  and  white). 

1-7.2  Half  Tone  Visual  images  con^sed  of  black,  white,  and  various  grada¬ 
tions  of  gray  such  as  black  and  white  photographs  and  black 
and  white  television  pictures. 

1.7.3  Color  Visual  images  con^josed  of  several  (more  than  two)  colors 

such  as  color  television  pictu.'^s  or  color  notion  pictures. 


Unitary  dots  or  flashes  of  light  (dots  in  the  context  of 
grids  or  other  lines  should  be  classified  as  visual 
graphic  -  1 .5.4) . 

Words  and/or  nunbers  presented  visually. 

Symbols  such  as  graphic  characters  not  in  text. 

Two-dimensional  schematic  images,  such  as  maps,  graphs,  and 
mathematical  curves. 

Two-dimensional  images,  such  as  television  pictures,  photo¬ 
graphs,  and  drawings. 

Three-dimensional  images  or  objects. 

Changes  in  the  general  illunination  level  in  an  enclosure  or 
the  environment. 
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TABLE  III-4 


Dimensions  of  Auditory  Cue  Characteristics 


2.5  Auditory  Pattern 

2.5.1  Steady  Sounds  or  noises  which  do  not  vary  in  pitch. 

2.5.2  Quavering  Soiinds  or  noises  which  alternate  rapidly  between 

two  pitches. 

2.5.3  Patterned  Sounds  or  noises  which  change  pitch  in  a  cyclic  or 

patterned  way  such  as  a  melody. 

2.5.**  Irregular  Sounds  or  noises  which  change  pitch  in  an  irregular 

or  random  way. 

2.5.5  Ambient  Sound  Changes  in  the  mixture  of  sounds  and  noises  which 

form  the  auditory  background  in  an  enclosure  or  in 
the  environment. 


2.6  Auditory  Range 

2.6.1  Limited  Range  Sounds  or  noises  limited  to  a  small  nunber  of  pitches. 

2.6.2  Voice  Range  Sounds  in  the  form  of  words  in  the  normal  range  of 

the  spoken  voice. 

2.6.3  Full  Range  Sounds  or  noises  which  vary  over  all  or  most  of  the 

audible  range. 


2 .7  Auditory  Pitch 
2.7.1  Low 


2.7.2  High 


Sounds  or  noises  with  a  low  pitch  (frequency). 
Sounds  or  noises  with  a  high  pitch  ( frequency) . 


TABLE  I1I-5 


Categories  of  Responses 


1 .  Verbal  responses  -  responses  delivered  in  an  audible  spoken  message,  with 
words  from  a  small,  stylized  set  or  freely  chosen. 

2.  yfritten  responses  -  responses  delivered  in  a  written  message,  with  words 
from  a  small,  stylized  set  or  freely  chosen,  or  by  checking  a  previously 
written  response  on  a  form. 

3.  Manipulative  responses  -  responses  delivered  by  positioning  dials,  controls, 
switches,  keys,  levers,  or  wheels,  or  positioning  of  hand-held  tools. 

4.  Exertive  responses  -  responses  delivered  by  the  application  of  force  to 
an  object  or  tool  with  the  hand,  foot,  or  body. 
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TABLE  III-6 

Dimensions  of  Response  Characteristics 


0.1  Response  Pattern 

0.1.1 

Single  Action 

0.1.2 

Repeated 

Action 

0.1.3 

Non-Ordered 

Action 

0.1.4 

Procedure 

0.1.5 

Continuous 

Regulation 

A  single  action  is  necessary  to  accomplish  the  task. 

A  single  action  performed  repeatedly  is  necessary  to 
accomplish  the  task. 

A  fixed  set  of  actions  is  necessary  to  accomplish  the  task 
but  the  order  of  performance  is  not  important. 

A  fixed  set  of  actions  performed  in  a  specified  order  is 
necessary  to  accomplish  the  task. 

A  variable  set  of  actions  is  necessary  to  continuously 
maintain  control  or  guide  a  changing  system  such  as  to 
steer  an  automobile. 


0.2  Required  Rate  of  Response 

0.2.1  Slow  Rate  For  a  single  action  (0.1.1),  the  time  between  cue  and  re¬ 
sponse  may  be  long,  i.e. ,  the  response  need  not  be  imne- 
diate.  For  a  series  of  actions  (0.1 .2-0.1 .5) ,  the  rate  at 
which  successive  actions  are  performed  may  be  slow. 

0.2.2  Fast  Rate  For  a  single  action  (0.1.1),  the  time  between  cue  and  re¬ 
sponse  must  be  short,  i.e.,  the  response  must  be  immediate. 
For  a  series  of  actions  (0.1 .2-0.1 .5) ,  the  rate  at  which 
successive  actions  are  performed  must  be  rapid. 


0.3  Required  Response  Effort 

0.3.1  Low  The  effort  required  to  perform  the  response  is  small. 

0.3.2  High  The  effort  required  to  perform  the  response  is  large. 


O.M  Response  Competition 

0.4.1  Lew  Response  is  made  when  few  other  actions  or  cues  eU"e  competing 

for  the  attention  of  the  operator  or  maintenance  personnel. 

0.4. 2  High  Response  is  made  when  other  responses  or  cues  are  competing 

for  the  attention  of  the  operator  or  maintenance  personnel. 


0.5  Response  Flexibility 

0.5.1  None  Cnly  a  specific  response  or  set  of  responses  oar.  accomplish 

the  task. 

0.5.2  Some  Any  of  a  nonber  of  responses  or  sets  of  responses  will 

accomplish  trie  task. 
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Note  also  that  the  task  category  does  not  necessarily  imply 
the  response  category.  Performing  gross  motor  skills  (15)  and  communicating  by 
voice  (7)  are  likely  to  have  responses  in  the  exertive  (4)  and  verbal  (1)  re¬ 
sponse  categories  respectively.  However,  steering  and  guiding  (13)  tasks  may 
require  responses  in  either  the  manipulative  (3)  or  exertive  (4)  category  v^ile 
responses  for  procedural  (16)  tasks  may  be  in  any  of  the  response  catejjories . 
Perceptual  and  mental  tasks  h-6)  may  also  require  responses  in  any  of  the  re¬ 
sponse  categories. 

(5)  Classifying  the  feedback  which  indicates  response  accuracy  and 
task  completion  is  also  an  essential  component  of  task  classifications.  The 
categories  of  feedback  are  visual,  written,  auditory,  verbal,  tactile,  kinesthe¬ 
tic,  olfactory,  and  gustatory.  The  categories,  defined  in  Table  III-7,  are 
quite  similar  to  the  categories  of  initiating  cues.  They  differ  on  two  points. 
First,  the  importance  of  language  use  in  feedback  is  recognized  by  distinguishing 
classes  of  visual  and  auditory  feedback  (written  and  verbal,  respectively)  which 
are  exclusively  based  on  language  and  making  them  separate  categories.  Second, 
the  distinction  between  body  motion  and  limb  motion  is  less  important  in  feed¬ 
back  and  they  have  been  grouped  into  a  single,  kinesthetic  category.  Feedback 
in  all  categories  should  be  judged  as  to  information  content,  source,  and  timing. 
The  values  to  be  distinguished  along  these  three  dimensions  are  defined  in  Table 

in. 8. 

It  may  be  tempting  to  end  the  search  for  analogous  tasks  as 
soon  as  the  first  minimally  acceptable  one  is  located.  Remember  that  the  accu¬ 
racy  of  the  training  estimates  (derived  from  the  analogous  tasks)  is  directly 
related  to  the  similarity  of  the  tasks.  Therefore  it  is  clearly  advantageous 
to  continue  the  search  for  an  analogous  task  until  a  close  match  is  identified. 
This  is  not  to  say  that  an  open  ended  search  for  the  "perfect”  match  must  con¬ 
tinue.  A  middle  ground  approach,  however,  will  pay  dividends. 

In  comparing  multiple  analogous  tasks  apply  the  remaining 
criteria  in  the  order  given.  That  is,  first  compare  the  specific  task  verbs. 

Only  if  the  task  verbs  are  the  saiae  should  you  apply  the  next  criterion,  stimu¬ 
lus  type.  You  should  consider  any  synonyms  identified  directly  in  the  Category/ 
Synonym  List  in  Appendix  2,  as  equivalent  to  identical  task  verbs.  As  with  the 
responiie,  correspondence  on  stimulus  means  agreement  both  as  to  category  and 

value  of  characteristics  on  the  dimensions  analyzed.  As  above,  only  if  the 

tasks  correspond  on  stimulus  should  you  consider  the  specific  "^sponse,  and 
necessary  conditions,  and  feedback. 

Table  III-9  is  a  hypothetical  example  of  the  application  of 
the  Ar»logcv:s  Task  Method  for  the  prediction  of  training  programs.  It  compares 
the  target  task,  Tr^ck  on  Aerial  Target  with  two  candidate  analogous  tasks  of 
tt*acking  aerial  targets.  In  this  case,  you  can  see  there  is  complete  corre¬ 
spondence  until  you  come  to  feedback  (Table  III-7).  This  indicates  that  you 

may  want  to  retain  both  candidates  ir  ot^ler  to  have  alternative  training  pro¬ 
grams.  The  training  program  for  analogous  task  ntmber  2  may  be  more  effective 
than  nisnber  1  when  it  is  modified  to  compensate  for  the  feedback  variation. 


TABLE  III-7 

Categories  of  Feedback  Information 


1 .  Visual  feedback  -  information  presented  through  the  sense  of  sight  with  the 
^eption  of  written  messages  and  texts. 

2.  Written  feedback  -  information  presented  through  the  sense  of  sight  by 
means  of  words  and/or  nunbers,  written,  printed,  or  displayed  in  the  form 
of  a  message  or  text. 

3.  Auditory  feedback  -  infcrmation  presented  through  the  sense  of  hearing  with 
the  exception  of  spoken  messages  and  texts. 

4.  Verbal  feedback  -  infcrmation  presented  through  the  sense  of  hearing  by 
means  of  words  spoken  directly  or  transmitted  by  comnunicatlons  equipment . 

5.  Tactile  feedback  -  information  presented  through  the  sense  of  touch,  in¬ 
cluding  information  about  the  texture,  size,  or  shape  of  an  object  and 
vibrations  on  the  skin. 

b.  Kinesthetic  feedback  -  information  presented  by  means  of  body  or  limb  motion 
either  through  the  sense  of  equilibrium  or  the  proprioceptive  sense. 

7.  Olfactory  feedback  -  information  presented  through  the  sense  of  smell. 

B.  Gustatory  feedback  -  information  presented  through  the  sense  of  taste. 
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TABLE  III-8 


Dimensions  of  Feedback  Characteristics 


0.1  Feedback  Infc»Tnation  Content 

0.1.1  None  No  feedback  given. 

0.1.2  Response  Feedback  indicates  whether  or  not  a  response  was  made 

Executiai  and  registered  by  the  equipment  but  does  not  indicate 

whether  or  not  the  response  was  correct. 

0.1.3  System  Feedback  indicates  the  general  status  of  the  system 

Status  and/or  its  environment.  Changes  in  system  status  from 

previous  reports  may  reflect  the  consequences  of  the 
response  made  and/or  independent  changes  in  the  sys¬ 
tem  (environment).  If  the  effect  of  the  correct  re¬ 
sponse  on  the  system  (environment)  is  known,  the 
correctness  of  the  response  may  be  inferred  from  the 
status  report. 

0.1.4  Response  Feedback  indicates  both  the  status  of  the  system 

Execution/  and/or  its  envirorjnent  and  the  performance  of  a 
System  Status  response. 

0.1.5  Response  Feedback  indicates  directly  whether  or  not  a  response 

Correctness  was  correct.  Feedback  about  response  correctness 
confirms  that  a  response  was  made  and  makes  system 
status  information  superfluous  as  feedback. 


0.2  Feedback  Source 

0.2.1  Intrinsic  Feedback  is  provided  automatically  by  the  system  or  is 

obvious  fnxn  the  effect  of  the  response  on  the  system 
or  its  environment. 

0.2.2  Extrinsic  Feedback  that  is  provided  by  the  system  only  when  re¬ 

quested  by  the  operator  or  maintenance  personnel. 


0.3  Feedback  Timing 

0.3.1  Immediate  Feedback  is  delivered  immediately  following  the 

response . 

0.3.2  Delayed  Feedback  is  delivered  at  some  prolonged  interval  after 

the  response. 
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TABLE  III-9 


TARGET  TASK:  Track  an  Aerial  Target 

I 

I 


? 


b.  Training  Assessment 

If  two  analogous  tasks  correspond  with  the  task  in  development  on 
all  the  criteria,  then  the  training  infonnation  from  the  two  tasks  should  be  con¬ 
sidered  jointly.  However,  cxie  final  criterion  should  be  considered  first:  the 
population  of  soldiers  who  will  be  performing  the  cask.  You  should  determine 
the  experience  level  (defined  as  pay  grade)  of  the  soldiers  who  will  be  opera¬ 
ting  and  maintaining  the  new  weapons  system  and  identify  which  analogous  task 
is  performed  by  soldiers  with  the  most  comparable  experience  level.  If  the 
analogous  tasks  correspond  here  too,  then  consider  both  tasks  together. 

For  each  analogous  task  identified,  obtain  the  details  of  training. 
These  details  will  be  in  the  Course  of  Instruction  (COI)  or  lesson  plans  and  the 
specifications  for  training  devices  used  in  the  training.  The  training  on  the 
analogous  task  can  be  used  as  the  training  plan  for  the  target  task  if  no  plan 
has  been  formulated.  If  there  is  a  training  plan,  then  differences  between  the 
training  plan  and  analogous  task  training  will  indicate  potential  difficulties 
in  training  to  be  watched  for  in  operational  testing. 


C.  Estimation  of  Effectiveness 


1.  TEEM 

TEEM,  for  the  present  at  least,  determines  effectiveness  by  manually 
recording  the  trade-offs  made  during  the  generation  of  an  estimated  training 
program.  A  computer  program  is  being  developed  to  accelerate  this  process.  You 
can  then  use  these  to  determine  the  potential  decision  cost  loss  for  the  chosen 
training  program  against  an  ideal  program  with  no  constraints.  Although  such  a 
measure  supplies  no  information  about  the  absolute  value  of  a  nunber  so  gener¬ 
ated,  it  does  provide  a  standard  of  comparison  for  several  training  programs 
generated  using  the  same  CTEA  method.  This  has  potential  advantages  not  only 
for  the  comparison  of  alternative  programs  for  a  given  weapon  syston,  but  also 
between  systems. 

In  the  TEEM  model,  this  measure  is  referred  to  as  the  efficiency  ratio. 

It  represents  a  value  vdiich  is  composed  of  the  efficiency  score  of  an  estimated 
program  with  real  world  constraints,  divided  by  the  efficiency  score  of  an 
idealized  program,  vdiich  is  subject  to  no  constraints.  The  actual  value  is 
generated  in  the  following  manner. 

a.  Record  the  selection  matrix  scores  fnom  Section  IIIB1  (Figures 
III -5.  6,  and  7)  for  each  media  matrix  and  each  task.  (See  Figures  Ill-lOa, 

10b,  ard  10c).  Ttiis  produces  three  matrices  of  sunned  values,  where  the  rows 
correspond  to  tasks  and  the  colunns  correspond  to  the  degree  of  fit  which  that 
task  had  to  each  of  the  potential  training  media  for  each  stimulus,  response, 
and  feedback  function.  Figure  III-1C  shows  such  matrices  completed  only  with 
the  njnbers  generated  in  our  example  (Section  IIIB1 ) .  If  the  largest  sum  in 
each  row  is  chosen  initially  for  devices,  a  large  number  of  different  equipment 
choices  is  produced,  spread  over  all  the  tasks  which  are  being  consider^  in 
that  functional  group.  Thus,  for  a  sample  group  of  six  tasks  there  might  be  six 
different  media  choices  for  each  of  the  three  media  functions  or  a  toti.  of  18 
different  devices.  If  cost  were  no  object,  and  there  were  no  resource  or  time 
constraints,  the  ideal  choice  of  media  would  be  all  IS  pieces.  The  total  of  the 
equipment  fit  scores  for  those  18  pieces  would  then  represent  a  score  of  an  ideal 
choice  '^thcut  constraints .  'iTiis ,  of  course ,  is  not  realistic ,  since  there  are 
always  constraints  that  enter  Into  any  decision.  As  these  constraints  are  ap¬ 
plied,  the  viability  of  a  particular  piece  cf  equipment  for  a  particular  task 
may  change.  For  example,  even  though  it  may  not  be  an  optimsd  choice,  you  may 
have  on  hand  a  particular  training  device  and  want  to  include  that  equipment  in 
the  program,  rather  than  buy  a  new  one.  The  particular  piece  of  equipment  may 
pormi-  combining  seversil  tasks,  rather  than  individually  training  each.  In  the 
above  example,  this  corresponds  to  choosing  one  of  the  other  sums  in  the  task  row, 
which  relates  to  the  particular  piece  of  equipment  you  desire  to  use.  If  you 
were  to  do  tlus  for  all  six  tasks,  i.e.,  force  the  clioice  of  a  single  piece  of 
equipment,  the  sum  of  the  numbers  corresponding  to  that  piece  of  equipment  would 
be  lower.  Thus,  the  efficiency  of  that  partievkar  decision  would  be  lower  than 
the  ideal  case,  as  would  all  other  potential  combinations.  If  this  value  is  then 
divided  by  the  ideal  first  value,  what  would  be  produced  is  a  ratio  of  actual  to 
ideal,  or  in  the  terminology  used  above,  an  efficiency  ratio. 

b.  After  you  have  recorded  in  the  three  matrices  (Figure  III-10)  the 
selection  scores  for  each  task,  select  the  largest  value  entered  for  that  task 
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in  each  matrix.  Add  these  largest  values  for  each  task  in  each  matrix.  This 
produces  three  sums  for  each  matrix:  ^stimulus,  ^response,  and  ^feedback. 

c.  Add  the  three  S  values  together  for  a  measure  of  the  overall  fit  of 
the  media  combination  chosen  for  all  tasks  and  all  fi.)nctions. 

gee 

Overall  Measure  =  stimulus  +  response  +  feedback 

d.  Record  the  overall  measure.  Sud  each  colunn  of  each  matrix.  Repeat 
the  above  procedure,  after  removing  the  media  In  each  stimulus,  response,  and 
feedback  matrix  having  the  lowest  coluan  sum  across  all  tasks.  Record  this  new 
overall  measure  and  repeat  until  all  media  have  been  considered. 

e.  Plot  the  ratios  of  the  overall  measure  values,  using  the  first  value 
as  the  denominator  for  all  the  remaining  values. 

Ratio  1  -  Overall  Measure  _  ^ 

First  Overall  Measure 


Ratio  2 


Second  Overall  Measure 
First  Overall  Measure 


=  Some  Value  < 


Ratio  n 


Last  Possible  Overall  Measure 
First  Overall  Measure 


=  Some  Value  «  1 


RATIO 

VALUE 


VALUE  REPRESENTING 
A  SINGLE  EFFICIENCY  RATIO 


12  3  4 

RATIO  NUMBER 
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2.  DIVAD  Gun 


Given  "generic"  tasks  as  developed  in  paragraph  A.1.  (page  III-1)  and 
training  alternatives  as  developed  in  paragraph  B.3  (page  111-20),  you  must 
again  use  your  judgment  and  your  subject  matter  expertise  or  someone  else's. 

You  probably  will  have  no  measures  of  effectiveness,  but  may  still  be  able  to 
rank  order  the  alternatives  as  to  expected  effectiveness.  For  example,  the 
analyst  in  the  DIVAD  Gun  CTEA  formulated  these  three  training  alternatives  (see 
paragrajii  B.3,  page  III-20). 

a.  Training  conducted  with  operational  equipment  only. 

b.  Training  conducted  with  reduced  operational  equipment  augmented 
by  the  classroom  trainer. 

c.  Training  conducted  with  further  reduced  operational  equipment 
augmented  by  both  the  classroom  trainer  and  the  maintenance 
trainer . 

The  first  alternative  was  judged  not  likely  to  be  effective  because  of 
its  relative  inflexibility  in  presenting  a  vai'iccy  of  battlefield  scenarios  to 
the  student;  the  other  two  alternatives,  because  of  the  presence  of  the  class¬ 
room  trainer,  offered  this  capability.  Of  the  other  two  alternatives,  alterna¬ 
tive  c  was  judged  most  likely  to  be  the  more  effective  because  of  the  presence  of 
the  maintenance  trainer. 

As  with  the  generation  of  tasks  and  training  alternatives,  this  method 
is  largely  intuitive  and  judgmental.  As  such,  you  would  not  use  it  unless  you 
had  nothing  else. 

3.  Analogous  Task  Method 

Having  developea  a  training  nrxjgram  by  the  analogous  task  method  (see 
paragrach  B.4.  above),  obtain  performance  information  to  be  used  as  a  measure 
of  effectiveness  of  the  training.  The  measure  is  defined  as  the  proportion  of 
soldiers  achieving  criterion  performance  on  the  task  following  training.  If 
data  from  the  hands-on  portion  of  the  Skill  Qualification  Test  (SQT)  are  avail¬ 
able  for  that  task,  then  use  them  to  calculate  effectiveness.  If  not,  use  the 
written  portion  in  their  place.  Where  no  SQT  data  are  available,  use  data  from 
an  end-of-course  test.  In  the  absence  of  all  formal  assessment  tests,  ask  the 
instructor  to  est.linate  the  proportion  of  soldiers  who  learn  the  task. 

If  the  Course  of  Instruction  (COI)  for  the  target  task  is  identical  to 
tliat  of  the  analogous  task,  use  the  effectiveness  measure  for  the  analogous  task 
as  the  estimate  of  effectiveness  for  target  task. 

If  the  COI  differ,  use  the  effectiveness  data  from  SQT  or  end-of-course 
tests  as  a  criterion  against  which  you  compare  the  proposed  effectiveness.  En¬ 
sure  that  the  criterion  dimensions  for  the  two  are  the  same.  If  you  have  iden¬ 
tified  more  than  one  analogous  tasK,  combine  t.he  data  in  the  following  manner. 

If  the  COI  and/or  lesson  plans  are  roioghly  the  same,  average  the  effectiveness 
measures  00  obtain  the  estimate  of  effectiveness  for  the  target  task.  If  the 
COI  differ  among  the  analogous  tasks,  select  that  with  the  highest  effectiveness 
measure. 
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As  data  on  training  are  obtained  from  OT  I  and  OT  II,  substitute  the 
direct  estimates  for  performance  on  the  task  for  the  measures  based  on  analogous 
tasks. 


Since  training  for  different  tasks  may  develop  at  different  rates  or 
you  may  find  analogous  tasks  for  only  some  of  the  critical  tasks,  it  is  entirely 
possible  that  some  of  the  tasks  will  have  only  analytical  measures  while  others 
have  performance  measures.  Therefore,  combining  measures  into  a  single  aggre¬ 
gate  effectiveness  measure  will  not  be  meaningful.  Even  if  all  measures  are 
performance  measures,  a  reasonable  set  of  weights  for  combining  the  measures 
may  be  difficult  to  deduc-.  In  both  cases,  a  verbal  rather  than  nunerical  over¬ 
view  of  training  is  suggested. 

4.  TRAINVICE,  PM  TRADE,  Training  Device  Requirements  Document  Guide: 

A  Pnxiedures  Handbook  for  Directorate  of  Training  Development  Project 
6ffices  for  Devices,  1979i 

If  it  is  known  that  a  simulator  or  other  major  training  device  is 
planned  or  considered  for  a  weapon  system,  the  CTEA  analyst  may  need  to  esti¬ 
mate  the  effectiveness  of  the  devices  as  part  of  the  overall  training  effec¬ 
tiveness  prediction.  (Please  note,  however,  that  if  a  major  device  has  been 
identified  as  required,  procedut'es  specify  a  separate  LCSMM  approach  with  a 
COEA,  CTEA,  etc.,  specific  to  its  development.)  An  excellent  method  for  you  to 
use  for  this  is  TRAINVICE.  Five  separate  analyses  are  required.  These  are: 

o  Task  ocnmonality  analysis 

0  Physical  similarity  analysis 

0  Functional  similarity  anailysis 

0  Learn.; --g  deficit  analysis 

o  Training  technique  assessiaent 

Information  on  similar  devices  already  in  the  Army  inventory  may  be 
helpful  and  may  be  obtained  by  contacting  the  Army  Training  Support  Center 
(AT^),  Ft.  Eustis.  This  group  has  access  to  information  on  all  Army  training 
devices  now  produced  or  being  developed.  They  will  need  from  you  all  the  data 
available  so  far  concerning  the  task(s),  skill  and  knowledge,  aund  operational 
effectiveness  objectives.  If  you  have  identified  training  m^ia  characteristics, 
they  should  receive  these  data  also. 


The  action  officer  at  ATSC  can  then  determine  if  training  devices  in 
the  inventory  have  characteristics  that  match.  An  exact  match  on  all  character¬ 
istics  is  'unlikely  but  some  currently  inventoried  devices  may  have  several  in 
common  with  your  ."equirenents.  For  each  device  ATSC  should  send  you  a  list  of 
tasks  it  is  designed  to  train.  For  tasks  that  correspond  to  cask  training 
requirements,  additional  information  t.bat  gives  a  list  of  task  elffisents  (or 
subtasks)  for  each  task  and  a  list  of  controls  a.nd  displays  involved  in  the 
perforaa.hce  of  each  task  may  also  be  proviaec.  If  no  existing  device  data  are 
available,  theoretical  device  concrpts  rtay  le  substituted.  A  ni-pothetical 
’ideal*  device  wculd  be  a  perfect  na.tc.n  or  ail  variables  and  you  may  codify 
as  seems  acvisable  to  catch  known  ccnstrai.nts  of  time,  equlooent,  etc. 
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To  analyze  alternative  device  effectiveness  you  may  proceed  as  in  the 
follovdng  example.*  Suppose  you  are  comparing  three  alternative  proposed  train¬ 
ing  devices.  We  will  assume  for  this  example  that  devices  A,  B,  and  C  are  pro¬ 
posed;  that  devices  similar  to  A  and  B  exist;  and  C  is  as  yet  only  a  concept. 

Two  known  task  training  requirements  are  Task  1 ,  Fire  main  gun  using  primary 
sight  (M-32;;  and  Task  2,  Adjust  fire  using  Burst  on  Target  (M-32  sight).  These 
tasks  and  their  subtasks  may  be  listed  as  shown  in  Table  III-10.  Next  you  will 
perform  the  five  analyses.  Task  Conmonality  is  first. 

a.  Task  Conmonality.  For  each  task  to  be  trained  on  each  training  de¬ 
vice  you  will  derive  a  task  conmonality  index.  Using  a  table  as  shown  in  Figure 
proceed  as  follows: 

(1)  List  the  task  elements  down  the  left  column  of  Figure  III-11. 

(2)  List  the  training  devices  or  concepts  to  be  assessed  across 
the  top  of  the  table. 

(3)  For  each  device  or  device  concept  under  consideration  list 
on  a  separate  piece  of  paper  the  elements  of  the  task  as  they  would  be  trained 
on  that  device. 

(4)  For  each  task  element  in  the  left  column  of  Figure  III-11 
determine  vrtiether  a  device  enables  the  trainee  to  practice  that  task  element 
by  examining  the  separate  list  of  t.ask  elements  for  that  device. 

(5)  If  the  training  device  does  allow  practice  of  that  opera¬ 
tional  task  element,  then  enter  a  "1"  in  the”  appropriate  ceil  for  that  device. 

^6)  If  the  partic'ular  task  element  is  not  represented  in  the 
training  device,  either  because  the  task  is  truncated  or  simplified,  then 
enter  a  "0"  in  the  appropriate  cell. 

(7)  Repeat  this  procedure  for  each  task  element  of  the  training 

task. 

(8)  Repeat  the  entire  procedure  for  each  trainiiig  device  or  de¬ 
vice  concept  under  consideration. 

(9)  For  each  traini.ng  device  or  device  concept  under  considera¬ 
tion,  total  the  nunber  of  "I's”  (i.e.,  the  nimber  of  task  elements  for  which 
the  training  device  allows  the  trainee  to  actually  p.^'actice  the  training  task) . 

(10)  Enter  the  total  nixt±)er  of  "I’s"  fcr  each  device  in  Figure 

iii-n. 


(11)  Derive  the  task  commonality  index  value  by  dividing  the  total 
nunber  of  "Ts"  by  the  total  nuTiber  of  task  elements  in  the  training  task  plus 
the  total  nunber  of  task  elements  unique  to  a  device  which  are  not  related  to 
the  training  requirements.  The  number  of  elements  unique  to  a  device  and  not 


•The  source  of  the  illustrative  example  is  t.he  referenced  docunent,  PM  TRADE 

\  >17-. 


I 


Table  III-IO.  Example  Task  Training  Requirements 


TASK:  Fire  main  gun  using  primary  sight  {H-32). 

Task  Elements: 

1.  Upon  receipt  of  the  alert  element  of  the  fire  command,  places  turret 
power  switch  in  “on"  position.  (Alert) 

2.  Upon  receipt  of  the  amunition  element  of  the  fire  command,  places 
main  gun  power  switch  in  “on"  position  and  coaxial  machine  gun 
switch  to  the  appropriate  position.  (Select  Gun) 

3.  Index  appropriate  ammunition  into  the  computer,  using  the  ammunition 
selector  control.  (Index  Computer) 

4.  Upon  receiU  of  the  target  element  of  the  fire  cc.wiand,  monitors  unity 
window  for  target,  and,  when  located  announces,  "Identified."  (Monitor) 

5.  Upon  receiving  control,  operates  controls  to  place  cross  hairs  of 
sight  on  center  of  target  vulnerability.  (Initial  Aim) 

6.  Tracks  target.  (Track) 

7.  Upon  receipt  of  execution  elenent  of  fire  command,  checks  final  lay 
of  the  gun  and  applies  appropriate  lead.  (Final  Aim) 

8.  Hears,  "Up."  announces,  "On  the  way,"  pauses  one  second,  and  squeezes 
trigger.  (Fire) 


TASK:  Adjust  fire  using  Burst  on  Target  (M-32  Sight). 

Task  Elements: 

1.  Upon  firing,  monitors  sight  for  target  and  relays  as  necessary  to 
reacquire  the  original  sight  picture.  (Relay) 

2.  Senses  the  round  (observes  burst  in  relation  to  target,  and  determines 
new  aiming  point  on  reticle)  and  begins  to  relay.  (Sense) 

3.  Ope'^ates  controls  to  pla'C  new  aiming  point  on  center  of  target 
vulnerability.  (Apply  BOf) 

4.  Tracks  target.  (Track) 

5.  Hears,  “Up,"  announces,  "On  the  way,"  pauses  one  second,  and  squeezes 
trigger.  (Fire) 
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Figure  III-ll,  Example  Task  Commoualicy  Analysis 


needed  is  included  in  the  formula  to  reduce  the  final  effectiveness  score  for 
those  devices  offering  greater  capability  (and  therefore  cost  more)  than  actually 
required. 

A  separate  task  conmonedity  table  is  used  for  each  task.  You  wIIl  see  a  second 
example,  Task  2,  at  Figure  III- 12.  How  faithfully  the  elemerit  is  represented 
in  a  training  device  is  considered  separately. 

b.  Physical  Similyity.  A  physical  similar'ity  analysis  is  based  on 
the  physical  similarity  or  fidelity  of  displays  (cues)  and  controls  (responses) 
in  a  training  device  when  compared  to  the  operational  equipment.  The  following 
procedure  is  applied  to  each  task.  The  first  example  is  Task  1 ,  shown  in  Fig- 
u.-'e  III-13. 


(1)  List  the  controls  and  displays  involved  in  task  performance 
down  the  left  column  of  Figure  111-13- 

(2)  List  the  training  devices  or  training  device  concepts  to  be 
assessed  across  the  top  of  Figure  III-13. 

(3)  For  each  control  or  display  listed  in  the  left  coi’jmn  of  Fig¬ 
ure  III-13,  rate  how  well  it  is  physically  represented  in  each  training  device 
or  device  concept  under  consideration.  B^e  your  ratings  of  physical  similarity 
on  the  four-point  scale  given  in  Table  III-11. 


Table  III-H.  Physical  Similarity  Rating  Scale _ 

Rating  Definition 

3  Identical .  The  trainee  would  not  notice  a  difference  between 

the  training  device  control  or  display  and  the  operational 
cont'ol  or  display  when  he  moves  from  the  training  to  the  job 
siti  ’*ion.  Include  for  consideration  the  location,  appearance, 
feel,  and  any  other  physical  characteristics.  Ignore  the  amount 
and  quality  of  Information  transmitted. 

2  Sjmi lar.  There  would  be  a  small  noticeable  difference  for  the 

trainee  between  the  training  device  control  or  display  and  the 
operational  control  or  display,  but  he  would  be  able  to  perform 
the  task.  There  might  be  a  decrement  in  performance,  but  any 
such  decrement  would  be  small  and  readily  overcome. 

1  Dissimi far.  There  would  be  a  large  noticeable  difference  quite 

apparent  to  the  trainee,  between  the  training  device  control  or 
display  and  the  operational  control  or  display  and  a  large  per¬ 
formance  decrement,  given  that  the  trainee  could  perform  at  all. 
Specific  instruction  and  practice  would  be  required  on  the  oper¬ 
ational  equipment  after  practice  on  the  training  device  to  over¬ 
come  the  decrement. 

Missino.  The  control  or  display  is  not  represented  at  all  In  the 
training  device. 
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Figure  111-12.  ^rianiplt-  Task  Commctial iev  Analysis 
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(4)  Repeat  the  procedure  for  each  training  device  or  training  de¬ 
vice  concept  under  consideration. 

(5)  For  each  training  device  or  device  concept  under  consioera- 
tion  add  the  ratings  for  each  control  and  display  listed  to  obtain  a  total  score. 

(6)  Enter  the  total  score  for  each  device  ii:  Fig-ore  III-13. 

(7)  Total  the  nimber  of  controls  and  displays  unique  to  a  device 
or  device  concept  in  addition  to  the  required  set  of  controls  and  liisplays. 

These  are  controls  and  displays  unrelated  to  the  training  requirements. 

(8)  Derive  the  physical  similarity  index  value  by  dividing  the 
sun  of  physical  similarity  ratings  by  three  times  the  number  of  controls  and 
displays  plus  the  nunber  of  controls  and  displays  unique  to  a  device  or  device 
concept . 


(9)  Enter  the  physical  similarity  index  value  in  Figure  III-13. 

A  separate  physical  similarity  table  is  used  for  each  task.  Our  selected  Task  2 
is  shown  in  Figure  III-14.  How  faithfully  the  training  device  nepreserts  the 
functioning  of  the  operational  equipment  is  considered  next. 

0.  Functional  Similarity.  The  functional  similarity  analysis  compares 
the  operator's  behavior  in  terras  of  the  information  flow  from  each  display  to 
the  operator,  and  from  the  operator  to  each  control.  You  will  assess  this  in 
terras  of  the  amount  of  inforraation  transmitted  frc.ra  each  display  to  each  control 
.  nd  the  type  of  in format ion- processing  activity  performed  by  the  operator.  The 
issue  is  r;'..'.  the  physical  fidelity  cf  a  cor,i..-ol  or  display,  but  whether  the 
operator  acts  on  che  same  amount  of  information  in  the  same  way  in  both  opera- 
:ional  a’  ■!  training  situations. 


C'ntr'ois  and  displays  are  considered  together  with  task  elements 
to  determine  rne  t>pe,  a.raou:it,  and  direction  of  infor'raation  flow  occurring 
during  task  performance,  lach  situation  in  v.td.ch  a  display  transmits  informa¬ 
tion  to  the  operator  (e.q.,  reads  it)  is  defined  as  a  stimulus  function,  while 
each  situation  in  which  the  operator  transmits  information  to  a  control  (e.g., 
operates  it)  is  termed  a  response  fiuiction. 


In  each,  the  amount  of  information  may  ce  estimated  by  the  nunber 
of  states  or  discrete  values  whies',  the  display  or  control  may  assume.  The  func¬ 
tional  sisrilarity  is  assessed  by  comparing  t.he  n'xiber  of  discrete  values  or 
states  in  the  training  situation.  The  range  of  values  may  be  partitioned  into 
four  major  levels:  (1)  continuous  (essentially  'unlimited),  (2)  multivalued 
(some  discrete  vailiie  greater  than  two),  o)  binary  (twxj  valc.-s),  or  (4)  not 
represented.  Figure  III-15  shows  perfemirg  functional  similarity  a.nalysis 
for  Task  1 . 


(1)  List  the  contrcls  and  displays  ^ivolved  in  task  performance 
on  the  operational  equipment  down  the  left  co)vm.  of  Figure  III-15. 

(2)  List  the  training  devices  ci-  training  device  concepts  to  be 
assessed  across  t.he  top  of  Figure  III-;?. 
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Figure  111-15.  Example  Functional  iimilarity  .-Vnalysis  l included) 
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(3)  For  each  control  or  display  listed  in  the  left  column  of  Fig¬ 
ure  III-15,  note  how  well  it  is  functionally  represented  in  each  training  device 
under  consideration.  Base  your  ratings  of  functional  similarity  on  the  four- 
point  scale  given  in  Table  III-12. 


Table  III-12.  Functional  Similarity  Rating  Scale 


Rating 

Dftf ini tion 

3 

Identical.  The  number  of  states  in  the  training  situation 
is  the  same  as  the  number  of  states  in  the  operational  setting. 

2 

Similar.  The  number  of  states  in  the  training  situation  is  at 
least  half  of  the  number  of  states  in  the  operationaT  setting. 

1 

Dissimilar.  The  number  of  states  in  the  training  situation  is 
less  than  half  of  the  number  of  states  in  the  operational  setting. 

0 

Hissing.  The  control  or  display  is  not  represented  at  all  in 
the  training  device. 

(4)  Repeat  the  procedure  for  each  training  device  or  training  de¬ 
vice  concept  under  consideration. 

(5)  For  each  training  device  or  device  concept  under  considera¬ 
tion  add  the  ratings  for  each  control  and  display  .isted  to  obtain  a  total  score. 

(6)  Enter  the  total  score  for  each  device  in  Figure  III- 15. 

(7)  Total  the  number  of  controls  and  displays  unique  to  a  device 
or  device  concept  in  addition  to  the  required  set  of  controls  and  displays,  if 
any  such  controls  or  displays  exist. 

(8)  Derive  the  functional  si.Tularity  i.ndex  value  by  dividing  the 
sum  of  functional  similarity  ratings  oy  three  times  the  nunber  of  controls  and 
displays  plus  the  number  of  controls  and  displays  unique  to  a  device  or  device 
concept . 

(9)  Enter  the  functional  similarity  index  value  in  Figure  III- 15. 

A  separate  functional  similarity  r.able  is  used  for  each  task.  Our  second  task 
is  analyzed  for  functional  siraila.''ity  in  Figure  III-16. 


d.  Skill  and  K.nowledge  Requirements.  This  aucalysis  assesses  the 
skill  and  knowledge  in  the  student's  repertory  before  traini.ng  and  compares 
tnern  to  the  skill  and  knowledge  required  for  successful  performance  of  the 
training  tasks.  Figure  III- 17  shows  how  this  analysis  is  done  for  Task  1. 

U)  List  the  skil_  and  knowledge  required  for  successful  task 
performance  down  the  left  col’m  of  Figure  III-17. 


Figure  III-16.  Example  Functional  Similarity  Analysis 
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Figure  III-17.  Example  Skill  and  Knowledge  Requirements  Analysis 
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Figure  III-17.  Example  Skill  and  Knowledge  Requirements  Analysis 
(continued) 
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Figure  III-17.  Example  Skill  and  Knowledge  Requirements  Analysis 
(concluded) 
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(2)  For  each  skill  or  knowledge  listed  in  the  left  column  of 
Figure  III-17,  estimate  how  "much"  of  the  skill  or  knowledge  the  average  trsiinee 
could  be  expected  to  have  upon  first  exposure  to  the  training  device,  and  esti¬ 
mate  how  much  of  the  skill  and  knowledge  he  must  possess  at  training's  canple- 
tion.  Use  the  two  scales  in  Tables  III-13  and  III-14. 


Table  III-13 .  Rating  Scale  for  Skills  and  Knowledge  Before  Training 


Rating 

Definition 

4 

Has  a  complete  understanding  of  the  subject  or  skill.  Can  do 
the  task  completely  and  accurately  without  supervision.  Has 
received  "skill"  training. 

3 

Understands  the  subject  or  skill  to  be  performed.  Has  applied 
part  of  the  knowledge  or  skill  either  on  the  actual  job  or  a 
trainer.  Has  done  the  job  enough  times  to  make  sure  he  can  do  it, 
although  perhaps  only  with  close  supervision.  Has  had  "proce¬ 
dural"  training. 

2 

Has  received  a  complete  briefing  on  the  subject  or  skill.  Can  use 
the  knowledge  or  skill  only  if  assisted  in  every  step  of  the 
operation.  Requires  much  more  training  and  experience.  Has 
received  "familiarization"  training  only. 

1 

Has  only  limited  knowledge  of  this  subject  or  skill.  Has  not 
actually  used  the  information  or  skill.  Cannot  be  expected  to 
perform.  Has  had  "orientation"  only. 

0 

No  experience,  training,  familiarity,  etc,,  with  this  skill  or 
knowledge.  Canno*  perform  a  task  requiring  this  skill  or 
knowledge. 

Table  III-14.  Rating  Scale  for  Skills  and  Knowledge  After  Training 


Rating  Definition 

4  Should  have  a  complete  understanding  of  the  subject  or  be 
highly  skilled.  Is  able  to  perform  the  task  completely, 
accurately,  and  independently.  Has  had  "skill''  training. 

3  Should  have  an  understanding  of  the  subject  or  skill  to  be 

performed.  Has  applied  part  of  the  knowledge  or  skill  on  the 
actual  job  or  a  trainer.  Has  done  the  job  enough  times  to 
make  sure  he  can  do  it  although  perhaps  only  with  close  super¬ 
vision,  Needs  more  practice  under  supervision.  Has  had 
"procedural"  training. 

2  Should  have  received  a  complete  briefing  on  the  subject  or 
task.  Is  able  to  use  the  knowledge  or  skill  only  if  assis¬ 
ted  in  every  steo  of  the  operation.  Requires  “"jch  more  train¬ 
ing  and  experience  to  be  able  to  perform  the  task  independently. 
Has  had  "familiarization"  training. 

1  Should  have  limited  knowledge  of  the  subject  or  skill.  Has 

not  actually  used  the  information.  Is  not  expected  to  perform 
the  task.  Has  completed  "orientation"  training. 

0  At  the  end  of  training,  the  trainee  should  have  no  experience 
or  training. 


(3)  Compute  the  differences  between  skill  and  knowledge  require¬ 
ments  before  and  after  training  by  subtracting  the  before-tr  .Ining  value  from 
the  after- training  value  for  each  skill  or  knowledge.  (Negative  differences 
are  set  equal  to  zero,  because  they  indicate  the  trainee  enters  with  more  skill 
than  necessary . ) 

(4)  Add  the  difference  scores  ("after"  minus  "before"  ratings)  for 
the  skills  and  knowledges  listed  to  obtain  a  total  difference  score. 

(5)  Enter  the  total  difference  score  for  each  device  in  Figure 

III-17. 


(6)  Derive  the  skill  and  knowledge  requirements  index  by  dividing 
the  total  difference  score  by  four  times  the  nimber  of  skills  and  kr.cwiecges. 


V  f  / 


Figure  III-17. 


Enter  the  skill 


a,nd  knowledge  requirements  index  value  in 


A  separate  skill  and  kncwledge  requi.^'ements  table  is  used  for  each  task, 
is  analyzed  on  Figure 


Task  2 


Figure  Ill-iS.  Example  Skill  and  Knowledge  Requirements  Analysis 
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Figure  III-18.  Example  Skill  and  Knowledge  Requirements  Analysis 
(concluded) 
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e.  Task  Training  Difficulty.  A  task  training  difficulty  analysis 
estimates  the  difficulty  (in  terms  of  training  time)  of  training  soldiers  to 
successfully  perform  the  required  tasks.  Ratings  are  assigned  based  on  the 
assjjimption  that  training  occurs  on  the  operational  equipment.  Figure  III- 19 
shows  this  analysis  for  Task  1 . 

(1)  List  the  task  elements  down  the  left  column  of  Figure  III-19. 

(2)  For  each  task  element  listed,  rate  the  amount  of  training  time 
for  sumounting  its  associated  deficit  relative  to  the  most  time-consuming  task 
element.  Table  III- 15  is  used. 


Table  III-  15.  Task  Training  Difficulty  Rating  Scale 


Bating 

Definition 

4 

poqnirpc:  aR  much  time  to  train  as  the  most 
time-consuming  task  element,  considering  all 
task  elements  for  aU  tasks  in  the  current 
analysis 

3 

Bequires  substantial  training  time,  but  less 
than  above 

2 

Bequires  a  moderate  an:ount  of  training  time 
relative  to  the  most  time-consuming  task  element 

1 

Requires  only  minimal  training  time  relative 
to  the  most  time-consuming  task  element 

0 

Requires  no  training  time 

(3)  Add  the  training  difficulty  ratings  for  the  task  elements 
listed  to  obtain  a  total  training  difficulty  score. 


(^)  Enter  the  total  training  difficulty  score  in  Figure  III- 19. 


(5)  Derive  the  task  '.r 
g  difficulty  score  by  f 


aining  difficulty  index  by  dividing  the 
oui'  limes  the  number  cf  cask  elements. 


(6)  Enter  thi  task  training  difficulty  index  value  in  Figure 

111-19. 


A  separate  task  training  difficulty  table  is  used  for  each  task  (see  Figure 
III-20  for  Task  2).  Note,  ncwever,  tne  .'^ating  scale  is  used  by  eval'iatir.g 
training  time  for  each  task  ele.r.ent  relative  to  tne  most  time-consumi.ig  element 
for  all  tasks  in  the  current  analvsis. 


Figure  III-19,  Example  Task  Training  Difficulty  Analysis 
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Figure  III-20.  Example  Task  Training  Difficulty  Analysis 


f.  Index  of  Training  Device  Effectiveness.  From  the  five  analyses 
just  completed  you  will  derive  overall  indexes  of  effectiveness  for  each  train¬ 
ing  device  or  training  device  concept  under  consideration. 

0  Task  conrionality 

0  Physical  similarity 

0  Functional  similarity 

0  Skill  and  knowledge  .requirements 

0  Taijk  training  difficulty 

The  task  commonality,  physical  similarity,  and  functional  similarity  analyses 
were  conducted  on  a  task-by-task  basis  for  each  training  device  or  training 
device  concept.  The  skill  and  knowledge  requirements  and  task  training  diffi¬ 
culty  analyses  were  independent  of  any  particular  device  and  addressed  specific 
personnel  and  training  requirements.  The  following  procedure  is  used  to  derive 
task  level  training  effectiveness  indexes. 

(1)  List  the  tasks  requiring  training  down  the  left  column  of 
Figure  III-21 . 

(2)  Obtain  task  corrmonality,  physical  similarity,  and  functional 

similarity  index  values  derived  in  previous  analyses  (Figures  III-13, 

III-15)  for  each  task  as  listed  on  Figure  111-21. 

(3)  Enter  these  values  in  the  annropriate  colunns  of  Figure  III-21 

(4)  For  each  task,  add  the  listed  task  conmonality,  physical  simi¬ 
larity,  and  functional  similarity  scores  and  divide  by  three.  The  obtained 
value  indicates  the  degree  of  correspondence  between  the  operational  equipment 
and  the  particular  t Training  device  for  that  task. 

(5)  Reoeat  this  analysis  for  each  training  device  (see  Figures 
III-22  and  III-23). 

g.  Personnel  and  Training  Requirements  Analysis.  The  next  analysis 
summarizes  the  person.nel  and  training  requirements  analyses. 

( 1 1  List  the  tasks  requiring  training  do'wn  the  left  oo„'.xin  of 
Figure  III-24. 


(2)  Obtain  the  skill  and  'rtnowledge  requi.''e.ments  and  task  training 
dificulty  index  values  derived  in  previc^js  analyses  (Figures  III-’T  and  Ill-.d) 
for  each  task  listed  in  Fig'ure  III-24. 


(3)  Enter  these  values 


tne  appropriate  colijrn.s 
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Figure  III-21.  Example  Training  Device  and  Operational  Equipment 
Task  Level  Correspondence 


h.  Overall  Training  Device  Effec> iveness  Index.  The  final  analysis 
derives  overall  training  device  effectiveness  indexes  for  each  device  or  device 
concept  by  combining  the  task  ]evel  training  device  and  operational  equipment 
correspondence  analysis  and  the  tasl'  level  personnel  and  trziinlng  requirements 
analysis. 


(1)  List  the  tasks  requiring  training  down  the  left  colunn  of 
Figure  111-25. 

(2)  List  the  training  devices  or  training  device  concepts  to  be 
assessed  across  the  top  of  Figure  III-25. 

(3)  Obtain  the  TC  +  PS  ♦  FS  and  SKR  +  TTD  values  for  each  task  and 

- 3 -  - ?■“" 

for  each  training  device  from  Figures  ITI-23  and  III-24  and  enter  them  in  the 
appropriate  columns  of  Figure  III-25. 

(4)  Multiply  the  TC  PS  ♦  FS  and  SKR  +  TID  values  tor  each  task 

5  2 

and  enter  in  the  appropriate  column  labeled  product. 

(5)  Add  the  product  values  for  all  tasks  and  enter  the  sum  in 
the  sun  of  products  location  for  that  device. 

(6)  Add  the  SKR  -f  TTD  values  for  each  task  and  enter  the  sum  in 

- 2 - 

the  sum  of  SKR  +  TTD'  location  for  that  device. 

2 

(7)  Divide  the  value  from  Step  5  ("A”}  by  the  value  from  Step  6 
("B").  This  value  is  the  training  device  effectiveness  index  for  that  training 
device  concept. 

(d)  When  comparing  alternative  existing  device  concepts,  an 
effectiveness  index  is  adjusted  by  multiplying  it  by: 

#  of  R^uired  Tasks 

of  Required  Task)  (#  of  Tasks  Unique  to  the  Alternative) 

This  factor  accouuits  for  capabilities  within  an  existing  device  that  are  not 
required  for  the  device  under  consideration.  Capabilities  not  required  mean 
additional  oost,  ar>d  this  correction  factor  adjusts  the  effectiveness  score  to 
reflect  ?.  loss  of  effectiveness  due  to  unnecessary  cost.  Where  a  theoretical 
device  concept  is  being  considered,  there  probably  will  be  no  tasks  unique  to 
it  and  the  correction  .factor  is  not  used. 

(9)  Repeat  the  procedure  for  each  training  device  or  traLning 
device  concept  under  oonsiderc»tion. 

Thus  you  can  report  that  a  predicted  overall  highest  ef fee* ’ veness  may  be  ex¬ 
pected  from  the  new  device,  C,  next  from  device  B  and  lowest  frooj  A.  These 
may  now  be  used  in  cost  effectiveness  analysis.  For  a  costing  methodology  see 
Section  HIT,  Costing  of  Training  Programs  -  The  Litton  Cost  Model  (p.  111-77). 
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Figure  IIT.-25.  Example  Training  Device  Effectiveness  Index 
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5.  TCA.  Hawley  and  Thomason,  Development  of  an  Air  Defense  Cost  and 

Training  Effectiveness  Analysis  Methodology,  2  vol.,  197^. 

TCA  makes  use  of  a  conA  uter  progrpiu,  but  before  you  use  it  you  will  need 
to  manually  prepare  the  input  data.  Instructions  with  the  program  will  tell  you 
how  to  input  the  oata  you  have  prepared.  The  following  procedure  will  lead  you 
step  by  step  through  the  preparation  of  the  input  data  and  the  interpretation  of 
the  output  information. 

PreparatiCTi  of  Input  Data 

Step  1 .  You  will  need  a  nunber  of  TCA  Worksheets  equal  to  the  nuaber 
of  tasks  you  are  considering  times  the  number  of  training  program  5ilteniatives 
to  be  compared  (tasks  in  task  list  x  nunber  of  aJ.tematives) .  Thus;,  if  you  were 
to  consider  twenty  tasks  and  three  different  training  program  alternatives,  you 
would  need  at  least  sixty  works! leets.  You  may  make  your  own  or  malce  photocopies 
of  the  one  .’n  Appendix  1  of  Annex  E. 

Step  2.  Organize  the  tasks  you  are  going  to  oor.sider  into  groups  of 
tasks  that  will  be  trained  together. 

Step  3.  For  each  task  prepare  a  separate  TCA  Worksheet  by  recording 
the  four-digit  task  nunber  at  the  top  of  the  sheet.  Record  the  identification 
of  the  training  program  alternative  also,  and  then  prepare  an  additional  work¬ 
sheet  for  each  additional  training  program  alternative.  That  is,  for  each  task 
you  will  prepare  a  worksheet  for  each  training  alternative  of  that  task.  See 
rxgures  cuju  . 

Step  4.  For  each  task  prepare  a  task  description  by  performing  the 
following  substeps: 

a.  Compa.*^  the  task  with  each  of  the  stimuli  characteristics  given 
in  Annex  A  (TEEM).  On  the  worksheet  under  Stlmulus~C^iaracteristics ,  and  under 
the  number  that  corresponds  to  the  nuji>er  of  the  stimulus  characteristic,  re¬ 
cord  a  ”1'*  for  each  characteristic  that  applies  and  a  "0"  for  each  character¬ 
istic  tnat  does  not  apply.  See  Figures  III-26  and  III-27  for  examples.  Record 
these  same  numbers  on  each  worksheet  for  the  same  task.  (You  must  be  thoroughly 
familiar  with  the  task  and  have  a  valid  reasoji  for  including  a  variable  in  the 
description  of  it.  See  Appendix  2,  Annex  E  for  examples  of  reasons  for  inclu- 
dii.g  a  variable  in  a  task  description.) 

b.  Compare  the  task  with  each  cf  the  response  characteristics  given 
in  Annex  t  (TEEM).  On  the  worksheet,  under  Respond  (giaracteristics  and  under 
the  number  that  corresponds  to  the  nunber  of  Uie  response  characteristics,  re¬ 
cord  a  "T*  for  each  characteristic  that  applies  and  a  "0"  for  each  that  dcas 
not  apply.  See  Figures  III-26  and  III-27  for  examples.  Record  these  same 
nunbers  on  each  worksheet  for  the  iame  task. 

0.  Compare  the  task  with  each  of  the  inftrmatlon  feedback  logic  vari¬ 
ables  given  in  Annex  A .  On  the  worksheet ,  under  Feedback Logic  and  under  the 
nunber  that  corresponds  to  the  nuaber  of  the  feedback  variable,  record  a  "1" 
for  each  feedback  variable  that  aipplies  and  a  "0"  for  each  that  does  not  apply. 
See  Figures  III-26  and  III-2^  for  exaibples.  Record  these  same  nuabers  on  each 
worksheet  for  the  same  task. 
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Figure  iII-26.  TCA  Worksheet 


Figure  III-27.  TCA  Worksheet 


d.  Compars  each  task  group  giv«i  with  the  functional  context  variables 
given  in  Annex  A  (TEEM).  For  each  task  in  the  task  group,  under  the  number  that 
corresponds  to  the  number  of  the  functional  context  variable,  record  a  "1”  for 
each  variable  that  applies  and  a  ”0”  for  each  that  does  not  apply.  See  Figures 
III-26  and  III-27  for  examples.  Record  these  same  numbers  on  each  worksheet  for 
the  same  task. 

Step  5.  For  each  training  program  alternative  of  each  task  prepare  a 
training  description  by  performing  the  following  substeps: 

a.  Search  through  the  list  of  training  equipuent  and  materials  in 
Annex  A  (TEEM)  to  find  the  stiniulus  media  o^  each  alternative  training  program 
of  each  task.  (Stimulus  media  are  the  means  through  which  information  is  pre¬ 
sented  to  the  student.)  In  the  training  description  part  of  the  worksheet,  under 
Stimalus  Media,  record  the  number  of  the  media.  See  Figures  III-26  and  III-27. 
(You  must  be  thoroughly  familiau*  with  each  training  program  alternative  so  that 
you  ca.n  properly  identiiy  each  medium  employed  in  the  training  of  each  task.) 

b.  Search  through  the  list  of  traying  eq^pment  and  materials  in 
Annex  A  (TEEM)  to  find  the  response  media  ot  each  alternative  training  program 
of  each  task.  (Response  media  are  the  means  by  which  the  student  demonstrates 
that  he  has  learned;  they  are  the  things  on  which  the  student  acts  as  he  re¬ 
sponds.)  In  the  training  description  part  of  the  worksheet,  under  Response 
Media,  record  the  numbers  of  the  media.  See  Figures  111-26  and  III-27. 

c.  S'arch  through  the  list  of  training  equipment  ard  materials  in 
Annex  A  (TEEM)  :o  find  the  feedback  media  of  each  ^temative  training  prograiri 
of  each  task.  (Feedback  media  are  the  means  through  which  the  student  is  in¬ 
formed  of  the  correctness  of  his  response.)  In  the  training  description  jjart 
of  the  worksheet,  under  Feedback  Media,  record  the  number  of  the  media.  See 
'^ig’ures  III-26  and  111-2^: 

d.  Search  through  the  list  of  training  methodologies  in  Annex  A  (TEEM) 
to  find  the  training  methods  for  each  task  group  in  each  training  program  alter¬ 
native.  For  each  task  in  the  task  grxjup,  .’^cord  the  numbers  of  the  methods  on 
the  worksheet  under  Methods .  See  figures  III-2&  and  III-27. 

Step  6.  You  new  have  a  description  of  each  task  to  be  considered  and 
a  description  of  each  alternative  training  program  of  each  task.  Sort  the  TCA 
Worksheets  by  training  program  alternative.  Within  the  stack  of  worksheets 
representing  each  alte.'native  trairring  program  arrange  the  worksheets  by  task 
group.  When  you  are  finished,  you  will  have  a  stack  of  TCA  Worksheets  for  each 
training  program  alternative  you  arc  examining.  WithLi  each  stack,  the  work¬ 
sheets  will  be  arranged  by  task  group. 

You  are  now  ready  to  go  to  a  cenj-uter  center  or  a  computer  terminal  to 
enter  your  data.  You  will  enter  a  separate  set  of  data  for  each  training  pro¬ 
gram  alternative  you  are  examining. 

Interpretation  of  the  Output  Information 

You  will  get  your  TCA  output  information  in  the  form  of  computer  prir.t- 
You  will  get  separate  pages  of  printout  for  each  training  preg.^'an  alter¬ 
native.  You  will  i.nterprfo  the  output  information  by  performing  the  following 
steps: 


step  1.  (Refer  to  Figure  The  format  of  the  printout  you  get 

may  not  be  exactly  like  that  given  in  Figure  111-28,  but  you  will  find  the  same 
information.)  First,  for  each  task  as  traii^  by  each  alternative  trainirjg  pro¬ 
gram,  examine  the  information  indicated  by  (?)  in  Figure  III-28.  These  are  the 
85  task  description  nvnbers  you  have  entered  for  the  task  (i.e.,  the  39  nunbers 
of  stimulus  characteristics  plus  the  16  nircbei-s  of  response  characteristics  plus 
the”  17  niint)er3  cf  feedback  logic  plus  the  13  numbers  of  functional  context  equal 
85).  Compare  thea  with  the  TCA  Worksheet  to  verify  that  they  are  correct.  Then, 
check  the  information  indicated  by  in  Figure  III-28.  This  information  must 
include  the  nuabers  under  Training  Description  in  the  TCA  Worksheet .  In  the 
example  given  in  Figure  III-28 ,  progrataned  text  (8)  was  the  stimulus  mediisn,  the 
response  mediun,  and  the  feedback  meditm.  '  The  methods  were  perfoncance-manual- 
independeit  practice  (6)  and  prograaned  instruction  (10). 

Step  2.  Examine  the  training  deficiencies,  redundancies,  and  excesses 
to  get  an  idea  of  the  nature  of  the  match  between  the  task  descriptions  and  the 
trailing  descriptions.  Tnis  information  may  be  of  value  you  when  you  comoare 
training  program  alternatives  and  ’'ecoomend  revisions.  (A  training  deficiency 
means  that  a  characteristic  in  the  task  description  is  not  matched  by  the  train¬ 
ing  description.  A  training  excess  means  that  there  is  a  capability  in  the 
training  description  not  required  by  the  task  description.  A  training  t*edui>- 
dancy  means  that  two  or  more  media  or  methods  match  the  same  task  character¬ 
istics.)  The  nusibers  of  deficiencies,  excesses,  and  redundancies  ai*e  indicated 
by  (3)  in  Figure  III-28,  The  nine  aeficiencies  (i.e,.  characteristics  in  the 
task  description  that  are  not.  matched  by  the  training  description)  are  indicated 
by  @  in  Figure  III-28.  (Note  that  in  this  printout  task  characteristics  are 
nunbered  sequentially  across  stimuli.^  characteristics,  response  characteristics; 
information  feedback  logic,  and  fXjnctional  context  —  39  ♦  16  +  17  13  *  85). 

See  Axinex  A  (TEEM) .  The  two  redundancies  in  this  example  (?)  show  that  the 
two  methods  in  the  training  description  (6  and  10)  both  match  the  task  character¬ 
istics  shown  (75  and  3l).  This  information  may  indicate  media  or  methods  that 
can  be  eliminated  from  the  training  program  without  harming  training  effective¬ 
ness.  The  7  training  excesses  in  the  example  in  Figure  III-28  are  indicated  by 
(1).  This  information,  too,  may  indicate  media  or  methods  that  can  be  elimi¬ 
nated  from  a  training  program  without  harming  training  effectiveness. 

Stop  3.^  Examine  statistics  for  each  task  and  each  task  group.  In 
p'igure  111-597” W  indicates  the  statistics  by  task.  The  nmters  in  the  row 
labeled  COINCIDENCES  show  how  many  matches  there  were  between  the  task  descrip¬ 
tion  and  the  training  description.  For  Task  3302,  for  example,  there  were  20 
matches  between  the  task  descripticxi  and  the  training  description.  The  numbers 
in  the  row  labeled  TASK  SUM  show  how  many  task  characteristics  there  uere  in 
the  task  description.  For  Task  3302,  for  example,  there  were  29  such  character¬ 
istics.  Tha  nunbers  in  the  row  labeled  CON.  RATIO  are  the  Training  Consonance 
Ratios  (TCR)  of  each  task.  The  TCR  is,  sLmply,  the  coincidences  over  the  tasR 
sm  (20/29  =  .687;.  in  Figuna  III-29  indicates  this  same  iQfomation  for 
a  whole  ta.sk  group.  Inforaation  sinLlar  to  that  indicated  by  In  Figure 
III -29  will  also  be  given  for  ai.2  tasks. 

Step  Establish  TCR  level  i.hat  represents  acceptable  training 
effectiveness.  This  step  is  based  on  judgment  to  be  refined  by  experience,  but 
a  TCR  below  .600  should  probably  be  considered  to  represent  U'siacceptable  train¬ 
ing  effectiveness. 
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FoT-mat  of  Printout  (from  Hawley  and  Thomason,  1978) 


Figure  III-29,  StatisClca  by  Task  (from  Hawley  and  Thomason,  1978) 


D.  Ctosting  of  Training  Programs  -  The  Litton  Cost  Model 


Introduction 


The  cost  factors  you  will  use  in  this  model  generally  fall  into  five 
categories: 

0  facilities  (classrooms,  laboratories,  learning  centers,  etc.) 

0  equipment  (projectors,  simulators,  learning  carrels,  etc.) 

0  instructional  materials  (texts,  films,  slides,  TEC  lessons,  etc.) 

0  personnel  (students,  instructors,  support  personnel,  etc.) 

o  miscellaneous  (amnunition,  POL,  parts,  other  consumable  supplies) 

The  cost  elements  that  make  up  these  categories  are  represented  by  FDRTPtAN 
names.  Each  is  defined  the  first  time  it  is  used.  There  is  also  a  Glossary  of 
Cost  Variables  as  Appendix  1  to  Annex  D. 

The  model  is  designed  to  estimate  the  training  costs  of  initial  training 
proficiency  on  the  syster4  under  study.  For  those  tasks  trained  to  proficiency 
in  the  institution,  proficiency  is  assumed  when  the  student  passes  his/her  and- 
of-course  tests.  For  tho.se  critical  taslcs  not  trained  in  the  institution  or 
trained  only  to  familiarity,  proficiency  is  assumed  >*en  the  soldier  success¬ 
fully  completes  the  appropriate  Skill  Qualification  Test  (SQT).  Thus,  refresher 
training  or  unit  effect!',  siess  training  beyond  this  point  is  not  relevant  to 
this  model. 

Although  the  model  can  develop  an  estimate  of  the  absolute  costs  of  a  sys¬ 
tem,  it  may  also  be  used  to  compare  costs  of  competing  systems.  In  the  latter 
case,  care  must  be  exercised  to  ensure  a  cocnon  bas.is  for  comparison,  i.e.,  the 
same  cost  factors  are  considered  for  both  systems.  Since  the  CTEA  process  is 
dynamic  and  occurs  at  several  points  in  the  life  cycle  system,  the  amount  and 
type  of  input  data  will  vary.  Obviously,  you  can  expect  less  system  data  at 
the  early  stages  of  the  system  development  process.  If  an  analogous  ta.sk  has 
been  identified,  then  the  cost  of  training  that  task  will  have  to  be  used  si.ice 
it  has  been  chosen  because  data  <x\  the  developing  system  is  lacking.  You  may 
have  to  modify  the  analogous  task  data  on  the  basis  of  common  sense.  For  ex¬ 
ample,  if  you  are  studying  some  sort  of  laser  individual  weapon  and  find  an 
analogous  task  for  the  M16A1  rifle,  it  would  not  make  sense  to  use  t.he  cost  of 
the  M16A1  rifle  Ln  the  cost  computations.  Get  the  estimated  cost  of  the  laser 
weapon  from  its  Program/Project/Product  Manager  (PM),  potential  manufacturer(s) , 
or  from  a  laser  expert  and  use  it.  Further,  remember  that  you  are  costing  only 
those  units  required  for  initial  proficiency  training  ~  not  for  equipping  the 
whole  Array.  If  there  is  insufficient  data  available  on  the  developing  system 
and  no  analogous  tasks  can  be  identified,  it  may  well  be  that  you  cannot  de¬ 
velop  the  cost  estimates.  However,  you  should  recognize  that  there  may  be  sub¬ 
ject  matter  cr  other  experts  whose  estimates  of  costs  can  be  used  if  necessary. 
It  may  be  that  you  can  proceed  to  estimate  the  ccsts  without  certain  cost  fac¬ 
tors  that  a-^e  unavailable.  Again,  you  should  ensure  comparability  of  factors 
between  competing  systems.  It  is  also  essential  that  you  explicitly  indicate 
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in  your  analysis  those  factors  that  have  been  omitted  until  data  become  avail¬ 
able.  You  can  expect  that  the  quality  and  quantity  of  the  data  will  be  up¬ 
graded  as  the  system  proceeds  through  its  development  stages  or  phases  of  its 
life  cycle. 

For  most  purposes  costs  in  thousands  of  dollars  to  the  nearest  hundred 
will  suffice,  e.g.,  $5,&10  would  be  represented  as  $5.5.  However,  this  should 
be  governed  by  your  own  good  judgmerit  to  ensure  that  undue  effort  is  not  ex¬ 
pended  to  develop  accuracy  in  some  variables  that  is  not  justified  by  the  rough 
estimates  of  other  vai'iables.  This  is  especially  important  in  the  early  stages 
of  development  of  the  system. 

Since  the  CTEA  methodology  considers  the  possible  use  of  analogous  tasks, 
there  is  another  important  caution.  The  following  cost  model  may  be  used  for 
estimating  the  costs  of  training  of  tasks  or  of  the  system.  When  using  the 
model  with  task  data,  the  system  costs  are  then  obtained  by  sunining  the  costs 
of  the  tasks.  You  must  be  sure  that  you  consider  certain  costs  only  once  (e.g., 
cost  of  acquiring  training  equinment)  if,  in  fact,  the  equipment,  macerials, 
etc.  required  for  these  costs  are  applicable  to  more  than  one  task. 

Procedures 

The  cost  model  is  Intended  to  be  an  automated  model.  Examples  of  manuaJ. 
computations  nave  been  included  in  the  text  to  help  you  develop  the  input  data 
for  the  model  and  to  further  explain  the  model.  In  some  cases  uou  will  note 
that  a  final  dollar  value  for  the  variable  is  not  shown.  These  computations 
are  incomplete  because  they  do  not  readily  lend  themselves  to  being  done  man¬ 
ually.  The  total  training  costs  of  concern  consist  of  the  initial  proficiency 
training  that  takes  place  in  the  institutions  or  schools  and  that  which  takes 
place  in  the  units.  Th;(.s  is  represented  by  Equation  1. 

TVALUE  =  IVWJJE  UVALUE  (1) 

where 

TVALUE  =  total  costs  attributable  to  initial  training 
on  the  task  or  system  being  studied. 

IVALUE  =  the  total  costs  associated  with  institutional 
training  of  the  task  system. 

UVALUE  =  the  total  costs  associated  with  initial  pro¬ 
ficiency  training  in  the  unit,  i.e.,  until  the 
scddier  passes  the  appropriate  SQT.  For  those 
tasks  trained  tc  proficiency  in  tne  institution, 
this  variable  =  0. 

Institutional  training  costs  are  further  divided  into  base  training  (e.g., 
classroom,  learning  centers)  and  field  training  conducted  by  the  institution. 
This  is  shown  in  Equation  2. 

IVALUE  s  BVALUE  ♦  FVALUE  (2) 

where 
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BVALUE  =  the  total  training  costs  associated  with 
institutional  base  training. 


FVALUE  =  the  total  training  costs  associated  with 
institutional  field  training. 


By  substitution: 

TVALUE  =  BVALUE  +  FVALUE  +  UVALUE  (3) 

DOD  requires  that  costs  and  benefits  in  CTEA  type  analyses  be  in  terms  of 
present  value  (or  discounted)  form.  The  discount  rate  is  prescribed  as  10  per¬ 
cent.  Since  all  materials,  facilities,  and  equipment  acquired  for  training  may 
not  be  consumed  during  the  initial  proficiency  training  period,  there  will  be  a 
remaining  value  of  these  assets.  This  remaining  value  is  treated  as  a  reduction 
in  the  cost  of  the  alternative  for  wnioh  the  use  of  the  assets  is  intended.  The 
fair  market  value  may  be  determined  from  sale  price,  scrap  value,  or  alternative 
use  value.  Thus  the  present  value  (i.e.,  costs)  of  institutional  base  training 
is  given  by  Equation  4. 


BVALUE  = 


BDACST(l) 


(1>d) 


BRVAST 


where 


(4) 


BDACST(i)  s  the  total  institutional  base  training 
non-discounted  costs  for  the  year  i. 

The  notation  (i)  following  a  variable 
name  indicates  that  that  particular 
variable  may  have  a  value  which  changes 
from  year  to  year,  since  i  represents 
the  year  measured  from  "today”. 

BRVAST  s  the  total  remaining  value  of  raalerials, 
facilities,  and  equipment  at  the  end  of 
the  planning  period  (N  years) . 

N  =  the  nvxiber  of  years  in  the  planning 

horizon  or  life  cycle  of  the  system.  If 
it  is  expected  that  traini.-^  to  initial 
proficiency  on  the  task  or  system  will 
continue  for  10  years,  for  example,  then 
N=10. 


d  =  discount  rate  (DOD  Instruction  7041.3 

prescribes  10  percents 


Equation  4.i  is  the  basic  constitutive  equation  reflecting  the  breakdown 
of  costs  irxo  associative  element  costs. 
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BDACST(i)  =  BFACOSCi)  +  BFH:OS(i)  +  BEp.QCI(i)  (4. 

+  BEM)CI(i)  +  BACIMD(i)  +  BALMMC(i) 

+  BSUPPY(i)  +  BCINST(i)  +  BPALST(i) 

+  BTRANS(i) 


where 


BFACOS(i)  =  cost  of  institutional  base  training  facility 

acquisition  in  year  i,  attributable  to  training 
the  particular  task  or  system.  If  a  facility 
is  to  be  shared,  take  a  pro  rate  share  based  on 
ratio  of  the  students  bei,ng  trained  on  the  task 
or  system  being  studied  to  the  total  nunber  of 
students  using  the  facility.  In  the  case  of 
existing  facilities  the  costs  of  which  have 
been  amortized  and  there  is  no  alternative 
planned  use  for  the  facility  or  if  no  facilities 
need  to  be  acquired,  the  factor  BFACOS(i)  s  0. 

In  the  case  of  an  existing  facility  whose  costs 
are  not  amortized  or  for  which  there  are  alter¬ 
native  uses  or  possible  sale,  tne  imputed  value 
of  the  facility  should  be  used.  These  costs  can 
be  based  on  fair  market  value,  scrap  value,  or 
alternative  use.  In  any  event,  discuss  this 
variable  with  the  Director  of  Industrial  Opera¬ 
tions  (DIO)  who  can  probably  give  you  good  advice 
and  coat  data  for  this  variable. 

You  should  also  examine  any  TRADOC  Form  124-R, 
Resource  Simnary  Supplement,  Other  Requirements, 
submitted  to  TRADOC  in  accordance  with  TRADOC 
Circular  351-3,  Training  Requirements  Analysis 
System  (T^) ,  Individu^  Tredning  Plan  (I^) 
(Figure  1).  These  forms  show  projected  MCA  and 
OHA  minor  construction  costs. 

BRCOSCi)  =  total  cost  of  institutional  base  training 
facilities  maintenance  in  year  i. 

BEAQCI(i)  3  total  cost  of  institutional  base  training 
equipment  acquisition  in  year  1 

EiSM3CI(i)  3  total  cost  of  institutional  base  training 
equipment  maintenance  in  year  i 

SACI^a^(i)  3  total  cost  of  institutional  instructional 
material  development  in  year  i 

BAIMHC(i)  3  total  cost  of  maintenance  of  institutior«al 
instructional  material  development  in  year  i 
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BFACOS(i)  =  cost  of  instituticmal  base  training  facility  acquisition  in  year  i 
attributable  to  training  the  particular  task  or  system 


EXAMPLE: 

New  facilities  are  not  requirevi  to  train  this  task  but  two 
existing,  vacant  maintenance  sheds  will  be  modified  by  constructing 
partitions  and  moving  electrical  outlets.  The  DIO  estimates  the 
cost  per  shed  will  be  $1500.  But  this  modified  facility  will  be 
used  to  train  three  other  tasks  of  the  system  as  well.  The  per¬ 
centage  of  time  that  it  wiLl  be  used  to  teach  the  particular  task 
we  are  interested  in  is  .25. 

BFACOS(i)  s  .25  •  $1500  •  2  =  $750  s  $.8  (thousands)* 


•The  symbol  *  aeans  "multipied  by."  Do  not  confuse  with  decimal  point. 
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TRADOC  Cir  351-3 


BSUPPY(i)  =  total  cost  of  supplies  consumed  in  year  i  in 
institutional  base  training 

BCINST(i)  s  total  coat  of  pay  and  allowances  of  all  in¬ 
structors  in  institutional  base  training  in 
year  i 

BPALST(i)  =  total  coat  of  pay  and  allowances  of  students 
in  institutional  base  training  in  year  i 

BTRANS(i)  =  totrl  coat  of  travel  (including  per  di«n)  and 
equipment  transportation  in  connection  with 
institutional  training  in  year  i,  and 

The  variables  in  Equation  4.1  are  further  defined  as  follows: 

BFMCOS(i)  =  BTSQFT(i)  •  BCSC5FT(i)  (4.11) 

where 

BTSQFT(i)  2  total  square  feet  of  institutional  base  training 
facilities  required  in  year  i 

BCSQFT(i)  2  cost  per  square  foot  of  operation  and  maintenance 
of  training  facilities  in  year  i  (includes  opera¬ 
tion,  janitorial  services,  utilities,  etc.). 

Either  the  DIO  or  Director  of  Facilities  Engineer¬ 
ing  at  your  installation  should  be  able  to  furnish 
data  on  this  item. 

and  where: 

BTSQFT(i)  2  [BSQFST  ♦  BDJSTR  •  SQFTIN]  •  MESL(i)  +  3SQFTA  (4.111) 

where 

BSQFST  2  nimber  of  square  feet  of  instituticaial  base  training 
facilities  required  for  each  student  (assumed  constant 
over  entire  planning  period).  Possible  sources  of 
data  are  the  DIO,  the  Management  Analysis  Division, 
and  input  data  to  TRADOC  Form  273-R  (Figure  2)  submitted 
in  accordance  with  TRADOC  Reg  11-12.  In  the  absence 
of  any  other  better  data,  you  could  use  an  average 
figure  of  44  sq  ft  per  student  for  classroom  space; 

95  sq  ft  per  student  for  laboratory  space,  and  68  sq 
ft  per  student  for  combination  classroom/laboratory 
space.* 


•Adapted  from  data  in  Hess  and  Kantar,  MODIA;  Vol.  5,  A  User*s  Guide  to  the 
Cost  Model. 
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BTSQFT(i)  =  total  square  feet  of  institutional  base  training  facilities  required 
in  year  i 

=  LBSQFST  +  CDINSTR  •  SQFT'IN)]  •  MESLCi)  +  BSQFTA 


EXAMPLE: 

The  DIO  informs  you  that,  for  this  task,  the  nimber  of  square 
feet  required  per  student  (BSQFST)  is  80  and  the  nmiber  of  square 
feet  per  instructor  (SQFTIN)  is  60. 

The  Management  Analysis  Division  tells  you  that  the  ratio  of 
instructors  to  students  (BINSTR)  for  this  task  is  1:10  or  .1  and 
the  maximum  e:q>ected  student  load  (MBSL(i))  is  20. 

The  DIO  also  estimates  the  total  square  feet  of  administrative 
space  (BSQFTA)  attributable  to  training  this  system  as  100.  DTD 
has  told  you  that  training  this  task  will  take  25  percent  of  the 
system  training  time. 

BTSQFTli)  s  [80  +  (.1  •  60)]  •  20  ♦  (100  •  .25) 

86  •  20  ♦  25 
=  1745  sq.  ft. 


BFMCOS(i)  =  total  cost  of  institutional  base  training  facilities  maintenance 


in  year  i. 

=  BTSQFT(i)  •  BC3QFl‘(i) 


EXAMPLE: 

llie  totai.  square  feet  of  facilities  for  this  task  has  been 
computea  as  17^5  square  feet. 

The  Director  of  Facilities  Engineering  informs  you  that  he 
uses  a  constant  trwilntenance  cost  per  square  foot  of  $2.00  per 
year  (for  Janitorial  services,  utilities,  and  general  upkeep). 

BFMCCS(i)  =  ms  •  2  =  $3490  s  $3.5  (thousands) 
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figure  of  44  sq  ft  per  student  for  classroom  space; 

95  sq  ft  per  student  for  laboratory  space,  and  68  sq 
ft  per  student  for  combination  classroom/ laboratory 
space.* 

blNSTR  =  ratio  of  instructors  to  students  in  institutional  base 
training  (assumed  constant  from  >ear  to  year) .  These 
data  should  be  available  in  school  Managanent  Analysis 
Division  or  similar  office  or  Director'  of  Instruction. 

SQFTIN  =  number  of  square  feet  of  facilities  required  per 
instructor  (assumed  constant) .  See  sources  for 
BSQFST  above. 

BSQFTA  =  total  square  feet  of  facilities  required  for  administra¬ 
tion  associated  vd.th  initial  training  on  the  system. 

See  sources  for  BSQFST  above. 

MESL(i)=  maximum  expected  student  load  in  year  i, 

BEAQCI(i)  =  BBQIMP(i)  •  MESL(i)  +  BEQCIS(i)  (4.12) 

where 

BEQIMP(i)  s  cost  per  student  of  the  variable-cost  institutional 

base  trairdng  equipment  that  must  be  acquired  in  year  i. 
Variable-cost  resourxies  relate  directly  to  workload  and 
change  as  the  workload  xevel  changes  over  a  relevant 
range.  Refer  to  TRADOC  Form  811-R,  TH/JX)C  Equipment 
Data  (Figure  3) ,  submitted  in  accorda.nce  with  TRADOC 
Reg  11-5.  The  Audio-Visual  Equipment  Directory  is  also 
useful  in  this  respect.* 

BBQCIS(i)  =  total  cost  of  fixed-cost  institutional  base  training 
equipment  acquired  in  year  i.  Fixed-cost  (or  static) 
resources  are  not  responsive  to  changes  in  the  work¬ 
load  (such  as  number  of  students)  ovc-r  a  relevant 
range.  You  should  check  data  submitted  to  TRADOC 
in  accordance  with  TRADOC  Reg  11-5  and  TRAXC  Cir. 

351“?.  TRADOC  Fora.  811-R  (Figure  3)  was  mentio.ned 
above  under  BBQIMF(i).  The  Individual  Training  Plan 
Proposal  (ITPP)  will  list  any  projected  new  or  re- 
viseo  extension  products  oy  tj^w  TEC).  TRATOC 

Form  125-R,  Resource  Summary  FY  _ ,  will  identify 

by  fiscal  year  by  element  of  expense  (BCE)  tne  OMA 
dollars  requir-?d  (Figure  4).  TRADOC  Form  'i24-R  will 
show  recuirements  for  major  equipment  items  not  funded 
ftxjm  the  CMA  appropriation  (Figure  l).  Training  Aids 
Service  Offices  (TASO)  are  also  possible  sources  for 

BFJQCKi)  s.  RCCPHTu)  •  SKi)  ?OMFEQ(i)  (4.15) 


wnere 


BEAQCKi)  =  toual  cost  of  institutional  base  training  equipment  acquisition 


in  year  i. 

=  BBQIMPCi;  •  MESL(i)  +  BBQCIS(i) 


EXAMPLE: 

In  order  to  train  this  task  each  student  will  have  a  Beseler 
Cue/See.  TRADOC  Fom  811-R,  TRADOG  Equipment  Data  shows  that  the 
acquisition  value  is  $14,300  (20  students  +  10  percent  spares  = 

22  units  at  $650  each).  TRADOC  Form  811-R  also  shows  two  35inn 
projectors  at  a  total  acquisition  value  of  $1250  are  required  for 
training  the  system.  Since  trainiiig  this  task  takes  25  percent 
of  Che  course  time, 

BEAQCKi)  s  14,300  +  1250  •  .25 
s  14,300  >  312.50 
=  $14 .6  ( thousands) 

You  are  also  advised  by  the  TASO  that .you  should  count  cn  re¬ 
placing  the  Beseler  Cue/See  beginning  in  the  seventh  year  at  a 
rate  of  10  percent  per  yeai-.  Your  pl^inning  period  (N)  =  10  years. 
Thus  the  5EX}IMP(i)  •  MESL(i)  costs  o/er  10  years  are 


Year 

rn 

2i3 

i 

4 

5 

6 

7 

8 

9 

10 

BEXJIhPCi)  • 

i 

1 

ME5L(i) 

0 

0 

_ 

0 

1300 

1300 

1300 

1300 

BEMJCI(i)  =  total  cost  of  institutional  base  training  equifxaent  maintenance 
in  year  i 

=  BCOPMT(i)  *  SI(i)  +  BOMFEQ(i) 

EXAMPLE: 

The  TASO  advises  you  that  maintenance  for  fielded  Cue/See 
will  cost  $10  per  unit  for  the  first  six  years  and  $40  per  unit 
per  year  after  six  years.  Thus  for  years  1-5  the  cost  is  22 
$10  =  $220.  Starting  in  the  seventh  year  10  percent  of  the  units 

I 

I  (22  •  .10  =  2)  will  be  rep3.aced  each  year  so  maintenance  cost 
will  be  (20  •  $40  +  2  •  $10  =  $820)  for  year  seven.  The  N=10 
year  matrix  is  as  shown. 


Year 

1 

2 

3 

4 

5 

b 

7 

1 

8 

9 

10 

&C0PMr(i) 
f  Sl(i) 

220 

220 

220 

220 

220 

220 

820 

VbO 

700 

640 

The  maintena.nce  costs  for  the  projectors  are  reported  as  $20 
per  year  for  ooth  or  »200  for  the  10-year  period,  prorated  for 
this  task  is  $200  x  .25  =  $50. 


BCOPMT(i)  =  cost  per  student  of  maintenance  of  vai’iable-cost 

institutional  base  traijiing  equipnent  in  year  i.  The 
T^O  may  have  data  that  will  help  with  this  variable 
as  may  PH  TRADE. 


BOKFEQ(i)  =  cost  of  operation  and  maintenance  of  fixed-cost 
institutional  base  training  equipment  in  year  i. 

The  TASO  may  be  able  to  furnish  data  on  this 
variable  as  may  PM  TRADE. 

SI(i)  =  average  nunber  of  students  (total  input  +  total  output) 
in  institutional  training  for  this  system  in  year  i. 

BACIMD(i)  =  BCIMD  •  R  •  MESL(i)  (4.14) 


where 


BCIMD  =  cost  per  student  in  year  i  for  instructional  material 
development.  See  TRADOC  Form  858-R,  TRADOC  Schools 
Mission  Data  by  Functicn/Organization  (Figure  5)  sub¬ 
mitted  in  accordance  \ath  TRADOC  Reg  il-5. 

R  =  number  of  repetitions  of  the  course  in  year  i  (assumed 
constant) . 

BAI^M:(i)  =  BCUIMD  •  SI(i)  (4.15) 


where 


BCUIMD  =  average  annual  cost  per  student  for  maintenance  of 

instructional  material.  (This  cost  is  assumed  constant 
out  could  be  made  variable  on  a  yearly  basis  by  inserting 
the  appropriate  yearly  value  where  used.)  The  Management 
Analysis  Division  or  DTD  should  have  experience  factors. 

BSUPPY(i)  =  BSUPLY(i)  •  SI(i)  (4.16) 


where 


BSiJPLY(i)  5  cost  per  student  of  institutional  base  supplies 

consumed  in  year  i.  See  TRADOC  Form  858-R  (Figure  4), 

TRADOC  Schools  Mission  Data  by  Function/Organization 
submitted  in  acco.’'dance  with  TRADOC  Reg  11-5. 

BCINSTd)  =  (BPALINd)  •  BINSTn  •  MESL(i)  +  BOVERH(l)  •  B.RCfAT(i) 

•  SKi)]  •  BHME  (4.17) 


whe«“e 


BPALIN(i)  s  average  anni.ial  pa}  arJ  allowances  of  an  instructor  in 
Lnstitutional  base  training  i.c  year  i.  Compute  this 
Lc  accordance  with  Section  III,  TRADOC  Resources  Fac¬ 
tors  Hacdbco'it . 


BACIMD(i)  -  total  cost  of  institutional  instructional  material  development  in 


year  i. 

=  BCIMD’  *  tiESLCl)  •  R 


EXAMPLE: 

DTD  has  developed  the  following  data  on  the  syst':»m  course 
as  input  to  THADOC  Forn:  858-R,  TRADOC  Schools  Mission  Data  by 
Function/Organization . 


training  this  particular  task,  three  (3)  TEC  lessons 
will  be  developed  at.  a  cost  of  $12,000  per  lesaon.  P.spr^uotion 
costs  will  be  $3C0C. 

DTD  has  cetemined  that  ranpower  rests  for  instructional 
material  development  for  the  course  -  $19?f000.  This  task's 
pro  i^ta  shar-e  =  .25  •  192,000  =  $48,‘X0. 

Nccwitts.’itandir.g  the  equation  given  above,  these  data  lend 
themselves  to  direct  vonputation  of  oAClMD(i)  as  fellows: 


aACLK)(t)  =  (3  •  12,000)  t-  3000  146,000 

=  $87000  =  $87  (thousands'' 


BAIMMC(i)  =  total  cost  of  institutional  instructional  laaterial  in  year  i 


=  BCUIMD  •  SI(i) 


EXAMPLE: 

informs  you  that  they  use  a  factor  of  20  percent  of  the 
develofinent  costs  to  compute  maintenance  costs  for  instructional 
materials.  Again,  it  is  easier  to  compute  BAIMCCi)  airectly 
without  having  to  use  the  equation. 

EAI^WC(i)  =  .20  «  oTGOO  =  $17.4  (thousancs) 


BSUPFYU)  =  total  cost  of  supplies  consumed  in  year  i  in  institutional  base 


training 


=  BSUPLY(i)  •  Sl(i) 


EXAMPLE: 

You  ask  the  Director  of  Instruction  how  he  computed  the 

entry  for  column  c  of  TRADOC  Form  bSb-R.  You  find  his  input 

for  base  supplies  was  based  on  $3.00  per  student  for  the 

course  you  are  Interested  in.  The  average  nunber  of  students 

(total  input  +  total  output)  trained  on  the  svstem  during 
2 

year  i  =  200.  Again,  note  this  task  takes  25  percent  of  the 
total  training  time. 

BSUPFY(i)  s  $3.00  •  200  •  .25  =  150  =  .2  (thousands) 


BCINST(i)  =  total  cost  of  pay  and  allowances  of  all  instructors  in  institutional 
instructional  base  trai.ning  in  year  i 

=  fBPALINU)  •  BINSTR  •  MESL(i)  +  BOVERH(i)  •  BRORAT(i)  •  SI(i)] 

•  BTIME 


EXAMPLE: 

In  order  to  compute  BPALIN(i)  (average  annual  pay  and  allow¬ 
ances  of  an  instructor  in  institutional  base  training  in  year  i), 
you  obtain  the  latest  military  (and  civilian,  if  needed)  pay  scales. 
You  obtain  from  the  Department  of  Instruction  the  nimbers  of  in¬ 
structors  by  grade  who  will  train  the  task.  By  using  the  metho¬ 
dology  on  page  35  i.n  Section  III  of  the  TRADOC  Resoiorce  Factor 
Handbook  (7  Deceinber  1976),  you  determine  the  average  pay  and  al- 
lo\<rances  of  an  instructor  is  $19,^100  =  $19.4  (thousands).  You 
have  dete.-Tnined  earlier  the  BiNSTR  for  this  task  is  .1.  The  De¬ 
partment  of  Instruction  indicates  that  the  student  input  for  year 
i  will  be  22259.  You  see  from  TRAIOC  Form  656-R,  lines  6,7,  and 

6  and  column  f  that  total  overnead  expenses  are  $3,059,700.  By 

j 

I  dividing  this  by  nunbcr  of  students  the  overhead  per  student  = 

1 

I 

I  $137.46  =  BOVERH(i).  DRORAT(i)  =  ratio  of  average  nunber  of  stu- 

I 

dents  training  on  this  task  in  year  i  to  total  nunber  of  students 

in  instituticnal  base  training  in  year  i  =  200  =  .009. 

22255’ 

The  system  course  is  4  weeks,  of  which  3  weeks  are  base 
training  and  one  week  is  field  training.  There  are  12  repetitions 
of  the  co'iTse  per  year. 

I 

i  BTI.ME  =  36  =  .75 

•  46 

-‘II.NSK, i)  =  ('.!•  14440  •  20)  (137.40  •  .009  •  2C0)j 

•  .75  •  .2t  =  (i668G  247.40)  •  .75  •  .25  = 

'3:C  =  3''.3  .tr.ou'^.cs) 


2/  *lloth  o  lifing  •{  fMS/IM€  r  cow'Ses  for  c/ie  Information  Prosrom  il  condutltd.  (Nol  requirtd  if  Information  Profran:  coses  are  identified  on  Figure  C-2.1 

Nomotlr  the  Trotniag  Support  Oiinsion  "ill  e»isc  onf|i  onnon-TA^DOC  ifislo/lotion*. 

l.ientifr  other  SI47XX  Funrtion  xihuh  contribute  significantly  to  resident  training  (Enception:  Oo  not  locfode  student  TOY  (8)47)/.)  Si  .2)). 

JL'  WctJC.-:  coi)  she:  fort.or.  whic.*:  can  he  r&  .es.Jent  b'Cining. 


BOVERH(i)  =  cost  per  student  of  institutional  base  operations  over¬ 
head  in  year  i.  These  data  may  be  available  from  the 
TRADOC  Form  858-R,  TRADOC  Schools  Mission  Data  by 
Function/Organization  (Figure  5),  submitted  in  accor¬ 
dance  with  TRADOC  Reg  11-5.  Also  check  the  Center/ 

School  Manageiaeiit  Analysis  Division  or  Pr-ogram  iind 
Budget  Division  or  other  office  responsible  for  these 
functions , 

BRORAT(i)  =  Ratio  of  average  number  of  students  in  initial  training 
on  the  pai’ticular  syst.em  to  average  total  niBiber  of 
students  in  institutional  base  training  in  year  1 . 

BTIME  =  fraction  of  year  spent  by  each  student  in  institutional 
base  training. 

BPALST(i)  =  ASTUPA(i)  •  BTIME  •  SI(i)  (4.l8) 


where 


ASTUl’A  =  average  annual  pay  and  allowances  of  students  in  year  i. 

Compute  tnis  in  accordance  with  Section  III,  TRADOC  Re¬ 
sources  Factor  Handbook. 

BTRANSCi)  =  BTRAVL(i)  «  SI(i)  +  BEQTRSu)  (4.19) 

where 

BTRAVL(i)  =  cost  per  student  for  travel  (including  diem)  in 

connection  with  institutional  base  t'aining  in  year  1. 
Compute  this  in  accordance  with  Section  III,  TR4D0C 
Resou.'ces  Factr"--  Handbook.  May  also  be  obtained  from 
Incuts  to  colunn  d  of  TRADOC  Form  858-'R. 

BEQTRS(i)  =  cost  for  transportation  of  equipment  used  in  institu- 
litnal  base  training  in  year  i.  Compute  this  in 
accordance  with  Section  III,  TRADOC  Resources  Factor 
Handbook. 

N 

BRVAST  =  7  LBFACOS^i)]  •  [l-(F/U))  (N-i+lj 
i=‘l 

llF.ACa(i)]  .  [I-(EAD^ 

■r  LP/'.CIMD(:  )]  •  [1-aAO)  (N-i^!)]  (U.2) 


FA.D  r,  annual  depr-jciaticn  rate  of  facilities  (assumes  straight - 
‘me  depreoiati' T:' .  The  DIO  shcull  be  able  tc  give  vou 
the  dcprcclat.on  rate. 


-Qu 


•«vhere 


BPALST(i)  =  total  cost  of  pay  and  allowances  of  students  in  institutional 


base  training  in  year  i 
=  ASTUPA(i)  •  Sl(i)  •  BTIME 


EXAMPLE: 

The  Office  of  Management  gives  you  a  breakdown  of  numbers  of 
students  by  grade  of  students  training  on  the  system  per  year.  By 
using  page  35  in  Section  III  of  TRADOC  Resource  Factor  Handbook 
(7  December  1979),  you  deteririine  the  average  pay  and  allowances  of 
a  student  (ASTUPA(i))  is  $10,128.  The  system  course  is  four  weeks 
of  which  3  are  base  training. 

BPALST(i)  =  10128  •  200  ♦  3  •  .25  =  ^379, 800  =  $379.8  (thousands) 

4 


BTRANS(i)  s  total  cost  of  travel  (including  per  diem)  and  equipment  transpor 


taticn  in  connection  with  institutional  training  in  year  i 
=  BTRAVL(i)«  Sl(i)  BBQTRS(i) 


EXAMPLE: 

The  Office  of  Management  tells  you  that  the  average  one  way 
mileage  used  for  cost  estimation  for  the  course  is  700.  Using 
Section  III  (page  4b)  of  the  TRADCX;  Resource  Factor  Handbook,  you 
find  the  factor  fcr  air  travel  is  $.1176. 

aTRAVL(i)  =  .1176  •  700  =  82.32 

BTPAVL(i)  •  Sl(i)  .25  =  82.32  •  200.25  =  44,116 

You  will  have  to  compute  costs  for  1/2  ton  of  Besseler  Cue/ 
See  aiid  tapes  from  the  depot  —  a  distance  of  1000  miles.  Again 
using  Section  III  (page  48)  of  TRADOC  Resource  Factor  Handbook. 

BEQTRS(i)  =  .5  •  .0568  *  1000  s  $28.40 

BTRANS(i)  =  $4,116  ♦  $28.40 

BTRANSd)  =  $4.1  (thousands) 


III- 101 


BRVAST  s  ranaining  value  of  facilities,  equipment,  and  instructional  materials 


at  end  of  planning  period  (N  years) 

N 

=  2  CBFACOS(i)]  •  [l-(FAD)(N-i+D3  + 
i=1 

tBEAQCKi)]  •  [1-(EAD)(N-i+1)]  + 
rBACIMD(i)]  •  [l-(IAD)(N-i+1)] 


EXAMPLE: 

The  DIO  informs  you  that  the  two  maintenance  stieds  that  will 
bo  used  for  the  course  are  fully  depreciated.  You  set  FAD  as  1 
(100»).  Therefore  CBFACOS(l)]  •  ri-(FAD)(N-i+1)]  s  0. 

The  TASO  recomnends  a  ten  percent  depreciation  rate  be  used 
i'or  the  combined  Cue/See  and  35  tau  projectors.  Thus,  EAD  =  .10. 

DTD  tells  you  they  do  not  intend  to  revise  the  TEC  lessons 
during  the  planning  period.  The  TASO  suggests  a  10  percent  depre- 
oiation  rate  on  the  tapes.  Thus,  lAO  s  .10. 


EAD  s  annual  depreciation  rate  of  equipment  (assumes  straight- 
line  depreciation).  The  DIO  and/or  the  TASO  (for  training 
aids)  should  be  able  to  furnish  these  data.  The  Audio- 
Visual  Equipment  Directory  will  also  give  data  on  useful 
life  of  such  equipment. 

lAD  s  annual  depreciation  rate  of  instructional  materials  (assumes 
straight-line  depreciation) .  The  following  table*  can  be 
used  to  derive  the  depreciation  rate  depending  on  the  type 
of  Instructloroil  materials. 


Courseware  Type 

Estimated  Useful  Life  (In  Years) 

Videotape 

1  to  5  years  depending  on  use 

Audiotape 

1  to  10  years  depending  on  use 

Film 

2  to  5  years  depending  on  use 

Filmstrip 

Unknown 

Photos 

Indefinite 

Slides 

Indefinite 

Transparencies 

Indefinite 

Printed  materied 

Indefinite 

Charts,  maps 

Indefinite 

Kicrofiche 

Indefinite 

Microfilm 

Unknown 

Record 

1  to  5  years  depending  on  use 

Turning  to  the  field  training  conducted  at  the  institution: 


N 

FVALUE  s  2 
i=1 


FT)CAST(i) 


(i+d) 


FTWAST 

(l4d)^ 


(5) 


where 

FDCAST(i)  s  total  non-discounted  cost  of  institutional  field 
training  in  year  i.  and 

FRVAST  s  remaining  value  of  equip;aent  and  instructional 

materials  used  in  institutional  field  training  at 
end  of  planrilng  period. 


FDACST(i)  =  FEAQCKi)  ♦  FEK)CI(i)  ♦  FSUPPYd)  ♦  FCINST(i)  ♦  PTALST(i) 

+  FPATRS(i)  *  FTRANS(i)  (5.1) 


•From  Hess  and  Kantar,  MODIA;  Vol,  5,  A  User’s  Guide  to  the  Cost  Model. 
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where 

FEAQGCd)  s  total  cost  of  acquisition  in  year  i  of  equipment  re¬ 
quired  for  institutional  field  training, 

FEMQCI(i)  s  total  cost  in  year  i  of  operation  and  maintenance  of 
equipment  required  for  institutional,  field  training, 

FSlJPPY(i)  s  total  cost  ''f  supplies  consumed  in  year  i  in  insti¬ 
tutional  field  training, 

FCINST(i)  s  total  cost  of  pay  and  allowances  in  year  i  of 

instructors  of  institutional  field  training,  and 

FPALST(i)  =  total  cost  of  pay  ar.d  allowances  iri  year  i  of 
students  in  institutional  field  training. 

F?ATRS(i)  =  total  cost  of  pay  and  allowances  of  troop  support 

(P8  or  P2)  in  year  i  for  institutional  field  training. 

FTRANS(i)  s  total  cost  of  transportation  in  year  i  for  equipment 
and  material  used  in  institutional  field  training. 

These  variables  are  further  defined  as  follows: 

FEAQCKi)  5  FEXJIMPd)  #  SI(i)  +  FEQCIS(i)  +  FBQTRS(i)  (5 

where 

FBQIMP(i)  s  cost  per  student  of  variable-cost  institutional 
field  training  equipment  that  must  be  acquired 
in  year  i.  See  data  source  conment  for  BBQIMP(i). 

FBQCIS(i)  =  total  cost  of  fixed-cost  institutional  field 

training  equipment  acquired  in  year  i.  See  data 
source  comment  for  BBQCIS(i). 

FEQTRS(i)  =  total  cost  of  equipment  of  troop  support  units 
attributable  to  training  this  task. 

FEM3CI(i)  =  FCOPMTd)  •  SI(i)  P0^FEQ(i)  FOKTRSCi)  (5 

where 

PCOPKr(i)  =  cost  per  student  of  maintenance  of  variable-cost 
institutional  field  training  equipment  in  year  i. 

See  data  source  comoent  for  BCOPMT. 

FX>fEQ(i)  s  cost  of  operation  and  maintenance  of  fixed-cost 
institutional  field  training  equipment.  See  data 
source  coanent  for  90MFBQ. 

POKTRSd)  s  cost  of  operation  and  maintenance  of  troop  supry)rt 
equipment  attributable  to  training  this  task. 
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FEAQCI(i)  =  total  cost  of  acquisition  in  year  i  of  equipment  required  for  in¬ 


stitutional  field  training 
=  FBQIMP(i)»  SI(i)  +  FEQCIS(i)  +  FEQ'raS(i) 


EXAMPLE: 

Although  no  equipment  for  field  training  of  this  task  must 
be  acquired,  DTD  tells  you  that  one  week  of  the  four'  week  course 
will  be  field  training  on  equipment  arxl  with  troops  of  a  school 
troop  (P8)  battery.  You  see  from  TRABOC  Form  858-R  (column  C) 
that  the  total  value  of  equipment  on  hand  in  the  battery  is  $51 ,000. 
As  previously  determined,  training  this  task  represents  .25  of  the 
training  time  on  the  system.  Field  trainir>g  represents  .25  of 
course  time  and  1  week  -  48  weeks  of  the  school  year.  There  are 
12  repetitions  of  the  course  during  the  year.  Thus, 

FEQTRS(i)  =  51,000  •  1  •  .25  •  12  =  $3187.50 

FEAQCI(i)  s  $3.?  (thousands) 
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Ill'll  wtiTiM 


FEMQCI(i)  =  total  cost  in  year  i  of  operation  and  maintenance  of  equipment 
required  for  institutional  field  training 

=  CPCOPMT(i)]  •  Sl(i)  POMFBQ(i)  +  POMTRS(i) 

EXAMPLE: 

The  battery  of  school  troops  (P8)  tells  j  ■>u  that  the  battalion 
is  using  a  figure  of  $2500  per  year  for  operation  and  maintenance 
of  the  battery  equipment.  Thus, 

FEMQCI(i)  s  $2500  *  12  •  .25  s  $156.25  =  $.2  (thousands) 

W 


FSUPPY(i)  =  [FPETROd)  <■  FAfWO(i)  +  FCONSU(i)3  •  SI(i)  (5.13) 

where 

F?ETRO(i)  =  cost  per  student  of  petroleum  products  (PCL)  con¬ 
sumed  in  institutional  field  training  in  year  i. 

1’ne  DIO  should  have  data  on  this  item. 

FAJfO(i)  s  cost  per  student  of  ammunition  expended  in  institu¬ 
tional  field  training  in  year  i.  See  TRADOC  Form 
810-R,  TRADOC  Ammunition  Costs  (Figure  6)  submitted 
in  accoi'danoe  with  TRADOC  Reg  11-5  and  the  Trainini; 
Ammunition  Management  Information  System  (TAMIS) . 

FCONSU(i)  s  cost  par  student  of  miscellaneous  consumables  con¬ 
sumed  in  institutional  field  training  in  year  i. 

See  data  source  comment  for  BSUPLY(i). 

PCINST(i)  =  FrALIN(i)  •  FINSTR  •  FTIME  •  MESL(i)  (5.'i4) 

where 

FPALIN(i)  s  average  annual  pay  and  allowances  of  an  instructor 
in  institutional  field  training  in  year  i.  Compute 
these  in  accordance  with  Section  III,  TRADOC  Resources 
Factor  Handbook. 

FTTME  s  fraction  of  year  spent  by  each  student  in  institutional 
field  training. 

FPALST(i)  =  ASTUPA(i)  •  FTIME  •  SI(i)  (5.15) 

FPATRS(i)  s  APATRS(i)  •  FTIME  (5.16/ 

where 

APATRS  s  annual  pay  and  allowances  of  troop  support  (PS  or  P2) 

P2  unit  costs  are  incurved  whether  the  unit  trains  or 
not  or  assists  in  training  or  r»ot.  Nevertheless,  in 
costing  alternative  training  programs,  it  may  be  useful 
to  include  these  costs  where  they  differ  significantly 
anoig  alte.'Tiatives.  You  may  firxj  troop  support  personrjel 
costs  in  colunn  g  of  TRADOC  Form  958-R  or  from  the  unit 
or  compute  them  using  Section  III  of  TRADOC  Resource 
Factor  Harjdbook. 

N 

FHVAST  s  )  [FEAQCKi)]  •  Cl-(EAD)(N-i+1)  j  (5.2) 

i^1 

Turning  to  the  training  conducted  in  the  Program  2  units  (only  if  the  task 
is  not  trained  to  proficiency  in  the  Lnstitut.ion) . 
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FSUPPY(i)  s  total  cost  of  supplies  consumed  in  year  i  in  institutional  field 


training 

=  [FPETRO(i)  ♦  FA^t10(i)  +  PCONSU(i)l  •  Sl(i) 


EXAMPLE: 

The  battery  tells  you  that  it  costs  $140  per  day  for  POL  to 
get  to  and  from  the  range  and  operate  for  the  day  on  the  range. 

FTETRO(i)  •  SI(i)  =  5  •  140  •  12  •  .25  =  $2100  =  $2.1  (thousands) 

TRADOC  Form  dlO-H  (TRADOC  Reg  11-5)  lists  ai^munition  costs 
fcr  the  course  and  for  the  year  at  $100,000.  Thus, 

FArtC(i)  •  Sl(i)  =  100,000  •  .25  s  25,000  r  $25.0  (thousands) 

The  battery  tells  you  that  they  use  a  personnel  cost  factor 
of  $1.00  per  man  per  day  in  the  field  for  consumable  supplies. 

There  are  90  men  in  the  battery. 

I 

FC(»SU(i)  •  Sl(i)  =  (90  •  5  •  12  •  $1.00  •  .25)  ♦  (200  •  5  | 

•  $1.00  •  .25)  s  1350  250  =  1600  =  $1.6  (Uhousands) 

I 
I 
I 

t 

J 


FSUPPY(i)  s  $2100  ♦  25,000  ♦  1600  -  28700  $28.7  (thousands) 


FCINST(i)  s  total  cost  of  pay  and  allovrances  in  year  i  of  lri3t'"”.ctors  of 


irstitutiwial  field  training 
s  FPALlN(i)  •  FINSTR  •  FTIME  •  h€SL(i) 


EXAMPLE: 

The  same  instructors  that  train  in  base  training  will  train 
in  the  field  (with  the  assistance  of  the  school  troop  battery) . 

The  average  pay  and  ailovances  of  these  instructors  was  determined 
previously  to  be  $19,440.  Tne  same  Listnactor/ student  ratio  of  .1 
holds.  Time  in  the  field  has  been  determined  to  be  12  =  .25  =  FTIME 

PCINST(i)  =  19,400  •  .1  e  .25  •  20  •  .25  =  $243  =  $„2  (thousands) 
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FPALST(i)  s  total  cost  of  pay  and  allowances  in  year  i  of  students  in 


institutional  field  training 


=  ASTUP4  •  FTIME  •  SI 


EXAMPLE: 

Average  utudent  pay  stxI  allowances  was  determined  as  $10,128. 
FPALST(i)  = -10,128  •  1  •  200  •  .25  s  10550  s  $10.5  (thousands) 

W 
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FPATRS(i)  =  total  cost  of  pay  and  allowances  of  troop  support  (P8  or  P2) 
year  i  for  institutional  field  training. 

=  APATRS(i)  •  rriME 

EXAMPLE: 

From  TRADOC  Form  858-R  (column  g)  you  find  the  annual  MPA 
costs  of  the  Cattery  are  $850, (X)0 

FPATRSti)  =  850,000  •  12  •  .25  =  $53,125  -  $53.1  (thousands) 

TiS 


FTRANS(i)  s  total  coat  of  transportation  of  equipment  and  anmunition  for 


institutional  field  training  in  year  i 


EXAMPLE: 

The  DIO  informs  you  that  the  anmunition  for  the  course  would 
have  a  shipping  weight  of  5  tons.  In  Section  III  of  TRADOC  Resource 
Factor  HandDook  you  find  a  factor  of  .0691.  The  DIO  also  tells  you 
that  the  distance  the  anmunition  is  shipped  is  750  miles. 

FTRANSCi)  =  5  •  .0691  •  750  •  .25  =  $64.78  =  $0.1  (thousands) 

which  can  be  disregarded  as  insignificant. 


I*  III 


Hl 


in  institutional  field  training  at  end  of  planning  period 


CFEAQCI(i)]  •  [1-(EAD>(N-i+1)] 


EXAMPLE; 

You  have  determined  FEAQCI(i)  to  be  $3.2  (thousands)  and  EAD 


to  be  .10. 


mz 


^  UDACST(i)  URVAST 

UVAL.UE  =  2  -  -  - -  (6) 

n=1  (l+d)^ 

^diere 

UDACST(i)  =  total  non-discounted  coat  of  unit  training  in  year  i, 

URVAST  =  renaming  value  of  facilities  and  equipment  used  in 
in  unit  training  at  end  of  planning  period  (N  years) . 

UDACST(i)  =  UFACOS(i)  +  UFMCOS(i)  +  UEAQCI(i)  +  UEMSCKi) 

+  USUPPY(i)  +  UCTORCi)  +  UCTliE(i)  +  liTRANS(i)  (6.1) 

where 

UFA(X)S(i)  =  total  coat  of  unit  training  facilities  acquisition  in 
year  i.  See  conments  for  BFACOS(i).  With  respect  to 
unit  training  facilities,  an  example  would  be  the 
Moving  Target  Simulator  (MTS)  facilities  operated  by 
USA  Garrisons  at  various  locations  to  train  REDEYE 
tracking.  "Basis  of  issue"  and  estimated  cost  data 
should  be  available  from  Department  of  Training  De¬ 
velopment  (DTD)  and/or  the  Department  of  Combat  De¬ 
velopments  (DCD).  Another  possible  source  is  the 
office  of  the  Program/Pro ject/Product  Manager  (PM). 

UFMCOS(i)  s  total  cost  of  unit  maintenance  of  training  facilities 
in  year  i. 

UEAQCKi)  =  total  cost  of  unit  training  equipment  acquisition  in 
year  i. 

UEH3CI(i)  =  total  cost  of  'onit  training  equJ.pment  maintenance  in 
year  i. 

USUPPY(i)  =  total  coat  of  supplies  consumed  in  unit  training  in 
year  i. 

UCTWR(i)  =  total  cost  of  pay  and  allowances  of  all  trainers  in  unit 
training  in  year  i. 

UCTNE(i)  =  total  cost  of  pay  and  allowances  of  trainees  in  unit 
training  in  year  i,  and 

UTRANS(i)  =  total  cost  of  travel  (including  per  diem)  and  equip¬ 
ment  transportation  in  corinection  with  unit  training 
Ln  year  i. 

The  variables  in  Equation  6.1  are  further  defined  as  follows: 

UFWCOSd)  =  UTSQFTd)  •  UCSQFT(i)  (6.11) 
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UFACOS(i)  =  total  cost  of  unit  training  facilities  acquisition  in  year  i 


EXAMPLE: 

Let  us  assume  for  illustrative  pi'rposes  that  each  of  ten  units 
requires  a  special  range  to  train  the  system.  Let  u.-,;  assume  further 
that  the  task  is  not  trained  to  proficiency  in  the  institution. 

(If  the  task  is  trained  to  proficiency  in  the  Listitution ,  by  our 
definitions,  UVALUE  =0).  Task  training  continues  to  represent  25 
percent  of  total  system  training.  It  is  estimated  chat  each  such 
P2  unit  will  have  to  train  an  average  of  16  trainees  oer  year  on 
Che  system.  Assume  fXirther  th.at  the  acquisition  cost  of  each  ra.nge 
is  $10,000  (which  can  be  obtained  from  the  DIO). 

Hn  average  of  estimates  from  the  units  indicates  that  it  will 
take  two  weeks  on  the  range  to  bring  each  school  graduate  to  pro¬ 
ficiency  (but  two  such  students  can  use  the  range  concurrently). 

At  other  times  the  range  will  be  used  for  refresher  training  (not 
to  be  costed)  during  a  50  week  training  year. 

UFACOS(i)  =  10,000  •  ,25  •  16  •  10  =  $b,000  =  $8  (thousands) 


UFMCOS(i)  =  total  cost  of  unit  maintenance  of  training  facilities  in 
year  i 

=  UTSQFT(i)  •  UCSQFT(i) 

EXAMPLE: 

The  Director  of  Facilities  Engineering  informs  you  that  an 
average  cost  of  maintaining  the  special  ranges  would  be  $500  per 
year. 

UFMCOS(i)  =  500  •  10  •  .25  *  1C  =  $400  =  $.4  (thousands) 


where 


UTSQFT(i)  -  total  sqiaare  feet  of  unit  training  facilities  required 
in  year  i  to  train  uhe  particular  task  or  svstem. 

Refer  to  MTS  example  above  or  special  ranges  required 
for  this  task  or  system.  See  comments  for  UFACOS(i) . 

UCSQFT(j)  =  cost  per  square  foot  of  operation  and  maintenance  of 
unit  training  facilities  in  year  i.  See  ootuxie  data 
conment  for  BCSCiFT(i).  Tiae  PM  or  TRADOC  System  Manager 
(TSM)  are  also  potential  data  sources, 

UTSQFT(i)  =  [USQFTE  +  UTNRE  •  USQFTR]  •  METL(i)  +  USQFTA  (6.111) 

where 

USQFTE  =  square  feet  per  trainee  of  unit  trainj.ng  facilities 
(assumed  constant) .  See  source  data  corments  for 
UFACOS(i). 

UTNRE  =  trainer  to  trainee  ratio  in  unit  training  (assumed 
constant) . 

USQFTK  =  square  feet  of  'onit  training  facilities  per  trainer 
(assumed  constant).  See  source  data  comments  for 
UFACOS(i). 

METL  s  maximum  expected  trainee  load. 

USQFTA  =  square  feet  of  administrative  facility  space  required 
to  support  unit  training  on  the  particular  system  being 
studied.  If  the  space  would  be  required  even  if  the 
system  were  not  being  trained,  this  variable  will  be  zero. 

See  source  data  comments  for  UFACCS(i). 

UEAQCI(i)  =  UEQIMP(i)  o  TU(i)  +  UEQCLS(i)  (6.12) 


where 


UBQIMF(i)  =  cost  per  trainee  of  variable-cost  equipment  used  in 
unit  training  in  year  i.  Potential  data  so'jrces  are 
DTD,  DCD,  appropriate  PM,  TSM,  or  PM  TRADE.  For 
fielded  equipment,  costs  can  be  computed  from  SB-700-20. 

UBQCIS(i)  =  cost  of  fixed-cost  equipment  acquired  for  unit 

training  in  year  i.  See  comments  for  UFQIMP  above. 

TU(i)  =  number  of  trainees  in  unit  training  in  year  i. 

l^QCI(i)  =  UCX)P^f^(i)  •  TU(i)  ♦  UOW^BQ(i)  (6.I3) 


where 
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UE4QCI(i)  =  total  cost  of  unit  training  equipment  acquisition  in  year  i 


=  UBQIMP(i)  •  TU(i)  +  UaCIS(i) 


EXAMPLE: 

Since  no  equipment  is  required  solely  for  training  to  initial 
proficiency,  UEAQCKi)  =  0  in  this  case.  Although  the  unit  may  be 
armed  with  the  system,  the  cost  of  the  system  is  properly  charge¬ 
able  to  the  operational  requirements  of  the  unit.  The  cost  of  the 
equipment  would  oe  the  same  even  if  there  were  no  training. 

Because  UEAQCKi)  s  0,  UEM3CI  also  is  zero. 
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(JCOPMT(i)  -  cost  per  trainee  of  maintenance  of  variable-cost  unit 
training  equipment  in  year  i.  Potential  data  sources 
are  PM,  TSM,  PM  TRADE,  TA50. 

UOMFEQ(i)  =  cosw  of  operation  and  maintenance  of  fixed-cost  unit 
training  equipmert  in  year  i.  See  cotnpents  for 
UCOPMT(i)  above. 

USUPPY(i)  =  [UPETRO(i)  +  UAMMO(i)  +  UCONSU(i)]  .  TU(i)  (6.14) 

where 

UPFTTROCi)  =  cost  per  trainee  of  petroleum  products  (POL)  consumed 
Li  year  i.  Each  major  unit  has  developed  consumption 
factors  for  unitnniles  per  gallon  and  vehicis-railes 
per  gallon  for  txcth  MOGAS  and  diesel  as  well  as  con¬ 
sumption  per  day  for  generators,  stoves,  etc.  Data 
are  also  available  for  "unit  day  in  the  field”  that 
combines  these  i^onsumption  figures.  The  FORSCCM 
training  manageme'it  control  system  (TMCS)  and  USAREUR 
control  of  logistic  expenditure  (COLEX)  present  such 
operating  cost  factors.  Latest  cost  per  gallon  for 
MOGAS  and  diesel  can  be  obtained  from  the  Defense  Fuel 
Supply  Center. 

UAFUO  =  cost  per  trainee  of  ammunition  expended  in  unit  training 
in  year  i,  TC  25-3,  Training  Ammunition,  may  be  used 
as  a  guide.  Costs  can  be  computed  fnjm  SB-700-20  and 
TAMIS  for  standard  ammunition.  Foi  developing  systems, 
check  PM,  TSM. 

UCONSU(i)  =  cost  per  trainee  of  miscellaneous  consumables  consumed 
in  unit  training  in  year  i.  Use  "unit  day  in  the  field” 
factor  by  type  unit.  Major  cost  item  generally  is 
spare  parts  and  this  will  be  included  in  the  factor. 

UCTNR(i)  =  UPATTJR(i)  »  UTNRE  •  UTIME  •  TU(,i)  (6.15) 

v;here 

UPATTiR(i)  =  average  annual  pay  and  allowances  of  a  trainer  in  unit 
training  in  year  i.  Compute  in  accordance  with  .'lection 
III,  TRADOC  Resourre  Factor  Hai'.dtook. 

UTIME  =  fraction  of  year  spent  by  each  trainee  in  unit  training. 

UCmE  =  UPATTIEd)  •  UTIME  «  TU(i)  (6.161 

where 

UPATHE(i)  =  average  annual  pay  and  allowances  of  trainees  in  unit 

training  in  year  i.  Compute  in  accordance  with  Section 
III,  TPADOC  Resourxie  Factor  Handbook, 
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USUPPY(i)  =  total  cost  of  supplies  consumed  in  unit  training  in  year  i 
=  CUPETRO(i)  +  UA>«0(i)  f  UCONSb’(i)]  •  TU(i) 

EXAHPLE; 

’•Unit  day  in  the  field"  data  from  several  batteries  average 
$150  per  day  for  a  battery  to  go  to  and  from  the  ranges  and  to 
operate  per  day  in  the  field.  There  are  90  men  total  in  each  of 
ten  such  batteries. 

UPETRO(i)  4'  TU(i)  s  150  •  10  •  5  •  2  •  .25  •  I6  =  $667  = 

15 

$.7  (thousands) 

Queries  to  the  G-3  (Training)  of  the  different  divisions  in¬ 
volved  indicate  an  average  of  five  rounds  per  trainee  for  profi¬ 
ciency  training  on  the  system  and  a  cost  of  $50  pei”  round. 

UA.'f^Ci)  •  TU(i)  =  $50  •  5  •  .25  •  16  •  10  =  $10,000  = 

$10  (thousands) 

"Unit  day  in  the  field"  data  from  several  batteric.:;  average 
$1.30  per  man  per  day  in  the  field  for  consumable  supplies  (in- 
clixles  spare  parts) . 

UCONSU(i)  •  TU(i)  =  $1.30  •  10  •  5  •  2  •  .25  •  I6  =  $520  s 

$.5  (thousands) 

USUPFY  r  $667  10,000  ♦  520  s  $11,187  *  $11.2  (thousands) 


UCTNR  =  total  cost  of  pay  and  allowances  of  all  trainers  in  unit  training  in 


year  i 

=  UPATNR(i)  •  UTNRE  •  UTIME  •  rj(i) 


EXAMPLE: 

You  determine  from  the  procedures  in  Section  III,  TRADOC 
Resource  Factor  Handbook  that  the  average  pay  and  allowances 
(UPATNR(i))  of  a  trainer  for  the  system  =  $1U,0C0.  The  ratio  of 
trainers  to  trainees  for'  initial  proficiency  training  =  1:2  =  UTNRE. 
Each  trainee  will  spend  two  weeks  of  the  50  week  training  year  in 
completing  his  initial  proficiency  tr*aining  (UTIME)  =  2  -f  50.  There 
will  ue  16  such  trainees.  The  task  training  will  take  25  percent  of 
the  system  training  time.  Thus, 

UCTNR  s  $14,000  •  1  •  2  •  16  ♦  10  *  .25  =  $11,200  = 

2  ^ 

$11.2  (thousands) 


UCTNE(i)  s  total  cost  of  pay  and  allowances  of  trainees  in  unit  training  in 
year  i 

=  UPATTJEfi)  •  UTIME  •  TU(i) 

EXAMPLE: 

Using  the  procedures  in  Section  III,  TRAIX)C  Resource  Factor 
Handbook,  ^ou  determine  the  average  pay  and  allowances  of  a  trainee 
(UPATNE(i))  s  $10,128.  You  have  already  determined: 

UTIME  =  2, 

TUU)  s  1b, 

UCITiE(i)  =  $10,128  •  _2  •  16  •  10  •  .25  s  $16200  = 

50 

$16.2  (thousands) 
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UTBANS(i)  =  UTRAVL(i)  •  TU(i)  +  UEQTRS(i) 


(6.17) 


where 

UTRAVL(i)  =  cost  per  trainee  for  travel  (including  per  diesi)  in 
connection  with  unit  training  in  year  i.  Compute  in 
accordance  with  Section  III,  TRADOC  Resources  Factor 
Handbook. 

UBQTRS(i)  =  cost  for  transportation  of  equipment  used  in  unit 
training  in  year  i.  Compute  in  accordance  with 
Section  III,  TRADOC  Resource  Factor  Handbook. 

N 

URVAST  =  2  [UFACOS(i)]  •  [l-(FAD)(N-i+1)l  +  (6.2) 

i=1 

tUEAQCKi)]  •  [1-(EAD)(N-i+1)] 

Having  determined  the  total  coat  to  train  each  individual  task  to  initial 
proficiency,  the  cost  of  the  total  training  program  may  be  determined  as  follows: 

M 

TPROGR  =  ^  TVALUEj  (7) 

.j=1 

where  M  s  nunber  of  tasks  contained  in  the  program. 

As  a  convenience  to  the  reader,  all  of  the  foregoing  equations  are  pre¬ 
sented  sequentially  without  text  in  Appendix  2  to  Annex  D. 

As  a  further  convenience,  a  matrix  of  variables  versus  potential  data 
sources  is  at  Appendix  3  to  Annex  D. 


UTRANS(i)  =  total  cost  of  travel  (including  per  diem)  and  equipment  transporta¬ 


tion  ir;  connection  with  unit  trainiJig  in  year  i 
=  CUTRAVL(i)]  •  TU(i)  •  UBQTRS(i) 


EXAMPLE: 

Since  there  is  no  trainee  travel  involved  in  this  case, 
UTRAVL(i)  =  0.  DIO  informs  you  that  anmunition  to  be  used  for  ini¬ 
tial  proficiency  training  has  a  shipping  weight  of  one  ton  and  the 
shipping  distance  averages  500  miles  for  all  ten  units.  The  factor 
from  Section  III,  TRADOC  Resource  Factor  Handbook  =  .0691. 

UEQTRS(i)  s  1  •  .0691  •  500  •  10  •  .25 
=  86.36 

=  0.1  (thousands) 

which  can  be  disregarded  as  insignificant. 


URVAST  =  remaining  value  of  facilities  and  equipment  used  in  unit  training  at 
end  of  planning  period  (N  year) 


N 

=  V  [UFACOS(i)]  •  [1-(FAD)(fl-i+1)]  +  [UEAQCI(i)  •  [1‘*(EAD)(N-i+l )] 
isl 


E.  Compai’ison  of  Training  Program  Alternatives 

1 .  TEEM 

Having  determined  the  effeGtiv«?ness  of  two  or  more  alternatives  by 
computing  their  efficiency  ratios  (see  pyaragraph  Cl  above) ,  compare  the  alterna¬ 
tives  on  the  basis  of  these  efficiency  ratios  and  the  cost  of  the  alternatives. 

In  order  to  help  you  avoid  dealing  with  very  large  nunbers  when  you  form  cost/ 
effectiveness  ratios,  you  may  want  to  normalize  the  costs  of  the  alternatives. 
(This  can  be  done  simply  by  dividing  the  cost  of  each  alternative  by  the  cost 
of  the  lowest  cost  alternative.  Note  that  the  normalized  ccst  of  the  lowest 
cost  alternative  becomes  1.  The  relationship  among  the  costs  remains  the  same, 
but  the  ratios  are  more  manageable.) 

2.  TCA 

The  beisis  for  this  process  method  has  been  established  by  the  procedures 
given  in  paragraph  C5  (TCA) .  The  output  information  derived  from  those  proce¬ 
dures  are  needed  for  this  procedure. 

Step  1 .  Assemble  the  TCA  output  information  derived  from  Process 
Method  C  as  shown  in  the  example  in  Table  III-16.  Arrange  task  information  by 
task  group  and  also  include,  if  applicable,  group  statistics. 

Step  2.  Compare  alternative  training  programs  by  TCRs  of  tasks,  of 
task  groups,  and  of  all  tasks  (the  overall  TCR).  Tentatively  select  the  alter¬ 
native  with  the  highest  overall  TCR. 

Step  3.  Compare  alternatives  task  by  task.  Compare  alternative  defi¬ 
ciencies,  excesses,  and  redundancies,  and  if  one  alternative  is  an  actual  program 
while  others  are  only  descriptions,  decide  if  revision  of  the  actual  program  can 
be  recommended  on  this  basis. 

Step  4.  Eliminate  from  consideration  training  program  alternatives 
with  unacceptable  TCRs. 

Step  5.  With  cost  estimates  from  Process  Method  III-D,  form  a  C/E 
ratio  for  each  remaining  alternative  (cost/TCR).  Choose  the  alternative  with 
the  lowest  or  lower  C/E  value. 

3.  BDM/CARAF* 

This  method  of  comparison  of  training  program  alternatives  assumes 
that  you  have  comparable  effectiveness  data  for  the  alternatives  you  are  com¬ 
paring  and  that  you  have  cost  data  from  which  you  can  derive  the  life  cycle  cost 
per  unit. 


a.  Complete  the  training  system  data  matrix  by  first  assigning  a 
weight  to  each  of  the  meeisures  of  training  effectiveness  (MDTEs)  selected. 
Assign  weigl’.ts  between  "1”  and  "99",  and  they  should  indicate  your  judgment  as 


•Adaptec  from  BDM  Services  Company,  Cost  and  Training  Effectiveness  Analysis 
(CTEA)  Hancbook  fcr  Action  Offices,  15  January  197^ 
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(adapted  from  Hawley  and  Thomason,  1978) 
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^em 


OVERALL  T.C.R 


to  the  relative  worth  of  the  MOTEs.  Usually  weights  between  50  and  90  will 
be  most  satisfactory.  If  a  MOTE  has  little  impact  upon  the  overall  effective¬ 
ness  of  the  system,  reconsider  the  need  for  the  MOTE.  Further,  if  a  MOTE  has 
a  weight  of  100,  you  would  not  need  to  have  other  MOTEs.  Use  you  best  judgment. 
For  example: 


MOTE^ 

MOTE  2 

MOTEj 

MOTE^ 

EE 

we:c::tg'> 

90 

50 

BASE  CASE 

*3  1 

b.  Determine  the  MOTE  data  values  for  the  base  case  and  each  of  the 
alternative  systems  as  shown  below.  Docunent  the  sources  of  data.  If  no  data 
are  available,  document  this  fact  also. 


MOTE, 

MOTE2 

MOTEj 

MOTE^ 

EE 

WEIGHTS* 

90 

50 

pasa 

BASE  CASE 

85 

90 

89 

30 

am 

mB 

c.  Add  MOTE^  values.  Subsequently  add  MOTEj  values,  etc. 


Examples: 

85 

90 

39 

30 

TW 

120 

d.  Divide  each  MOTE  value  by  the  sum  of  the  MOTE  values  from  previous 
step  shown  in  the  examples.  This  produces  a  relative  effectiveness  score  within 
each  MOTE. 


.MQ 

mWTjSO 


.75 

120T9Ob 
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90 


50 


BASE  CASE  1 

.'*9 

.75 

-  '^A^ 

.51 

.25 

^2 

*3 

1 

1 

\  .  -J 

e.  When  previous  steps  have  been  completed  for  all  training  systems 
and  all  MOTEs,  multiply  the  decimal  value  (relative  effectiveness  score)  pro¬ 
duced  in  Step  d  times  the  weight  assigned  to  the  particular  MOTE  and  insert  the 
product  (weighted  relative  effectiveness  score)  into  the  appropriate  spaces  on 
the  matrix. 


MOTE, 

MOTE2 

MOTEj 

MOTEi, 

EE 

WEIGHTS^ 

90 

50  _ 

X 

BASE  CASE 

44.1 

37.5 

45.9 

12.5 

"2 

A, 

J 

f.  Add  the  values  for  the  base  case  and  for  each  training  alternative 
actxiss  the  horizontal.  Insert  the  sums  (total  weighted  effectiveness  score) 
in  the  appropriate  ”E"  spaces  in  the  training  system  matrix. 


Examples :  ,  1 


45.9 

12.5 

■50' 
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ZE 


MOTEj  MOTE2  MOTEj  MOTE^ 


WEIGHTS^ 

90 

50 

BASE  CASE 

kk.\ 

37.5 

81 .6 

45.9 

12.5 

58.4 

^2 

A3 

g.  List  the  total  life  cycle  costs  for  each  training  program  alterna¬ 
tive  as  shown  in  the  example  below. 

h.  Determine  the  total  number  of  hours  (or  other  appropriate  unit  of 
use)  of  useful  life  of  the  systems  and  list  as  shown  below. 

i.  Divide  results  of  Step  g  by  the  results  of  step  h  as  shown  in  the 
example  below.  Insert  the  quotients  as  shown. 


TOTAL  LIFE  CYCLE  COSTS 

TOTAL  LIFE  CYCLE  UTILIZATION 
UNITS 

life  cycle  cost  per  unit 


j.  The  comparison  of  training  program  alternatives  is  a  cost  benefit 
analysis  with  fonmilae  as  shown  below.  These  formulae  show  the  comparison  among 
a  base  case  (SC)  and  three  alternatives  (A^  A2,  A,) .  The  left  colunn 
shows  the  combinations  of  comparisons  of  two  alternatives  at  a  time.  With  fewer 
alternatives  there  will  be  fewer  combinations  of  two.  Each  pair  comparison  has 
a  corresponding  formula  in  tha  right  colunn.  These  equations  establish  effi¬ 
ciency  ratios  (e.g.,  ^)  which  wlien  multiplied  by  the  "cost  per  unit"  (step  1 

^1) 

above)  give  a  product  to  be  compared  with  the  "cost  per  unit  of  the  other  al¬ 
ternative  of  the  pair. 


COST  BENEFIT  ANALYSIS 


BC-A,  C3  <  ^ 

1  A, 


C„  <  C  - =■ 

B  -  ''A,  E. 

2  A, 


C„  <  C  - - 

B  -  A.  F. 

3  A, 


^A  -^A-r^ 
\  «2  '"a. 


A, ‘A  C  1C 


^-3  S^S-iT 


k.  Start  by  selecting  two  alternatives  for  comparison.  For  the  fol¬ 
lowing  example,  the  base  case  is  compared  with  alternative  one. 

BC  A, 


1.  Find  the  appropriate  formula  from  paragraph  j  above,  riglit  column. 


Example: 


<  Cai  ‘y 

^Al 


m.  Divide  the  measure  of  efficiency  for  the  base  case  (Eg)  by  the 
measure  of  efficiency  (E^  )  of  the  alternative. 


n.  Multiply  the  vadue  obtained  in  Step  m  by  the  cost  per  unit  use 
for  the  first  alternative  training  system  (C.  )  (from  Step  9). 

''1 

n,m.n)  x  (1.4)  =  15,555.55 
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o.  Compare  the  value  obtained  from  Step  n  with  the  "cost  per  hour 
use"  for  the  base  case  (Cg).  The  mathenatical  symbol  "£*’  means  "equal  to  or 
less  than".  If  Cg  is  "equal  to"  the  value  obtained  in  Step  n,  the  two  systems 
are  equal  on  a  cost  benefit  comparison.  If  is  "less  than"  the  value  obtained 
in  Step  n,  the  base  case  is  better  than  the  first  alternative.  If  Cg  is 
"greater  than"  the  value  obtained  in  Step  n,  the  alternative  is  better  than 

the  base  case. 

p.  Make  cost  benefit  cooqjariscns  between  each  of  the  remaining  sys¬ 
tems  (if  any) . 

q.  Select  the  optimal  system, 
n .  DIVAD  Gun 

Given  alternatives  rank-ordered  on  the  basis  of  estimated  effective¬ 
ness  and  cost  estimates  for  the  alternatives,  establish  a  cost  effectiveness 
matrix  similar  to  tne  following. 


Alternatives 

Effectiveness 

Cost 

Overall 

Ranking 

1 

3 

3 

3 

2 

2 

2 

2 

3 

1 

1 

1 

1 

In  the  DIVAD  Gun  CTEA,  for  example,  the  estimated  cost  ''f  Alternative  1 
was  roughly  three  times  the  cost  of  Alternative  3  (which  was  est  jnated  to  be  the 
most  effective  alternative) .  Alternative  3  was  easily  identified  as  the  best 
choice. 


Your  situation  may  not  fall  into  place  as  nicely  as  this  DIVAD  Gun 
case,  but  again  your  expertise  and  judgment  will  have  to  suffice  if  you  have  no 
other  data. 

•  5.  DRIMS  CTEA  (USAIS,  Diagnostic  Rifle  Marksmanship  Simulators,  Cost  and 

Training  Effectiveness  Analysis,  August  1976)* 

This  method  has  been  used  by  the  Infantry  School  and  is  particularly 
appropriate  in  comparing  altematj.ve  simulators  of  an  operational  weapon  system 
(base  case)  as  a  result  of  testing. 

a.  List  the  critical  skills  that  must  be  taught  by  the  alternative 
systems  you  are  comparing.  Provide  colunns  for  each  alternative. 


•Adapted  from  the  cited  study. 
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b.  For  each  alternative  check  the  cell  for  each  critical  skill  the 
alternative  can  teach,  as  in  the  example  below.  Obviously,  the  operational 
system  will  meet  all  the  critical  skill  requirements. 


Teach  Critical  Skill  Alt  1 

Alt  2 

Alt  3 

Skill  1 

X 

X 

2  X 

X 

X 

3  X 

X 

4 

X 

X 

5  X 

X 

X 

n 

c.  For  each  alternative  coinpute  the  percentage  of  the  total  nunber  of 
critical  skills  that  the  alternative  has  the  capability  of  teaching. 

d.  Rank  order  uhe  alternatives  for  the  factor.  Relative  Capaoility  of 
Teaching  the  Critical  Skills  from  highest  to  lowest  (1  to  n) . 

e.  Determine  from  your  usst  data  what  you  will  use  as  your  measure  of 
training  effectiveness.  In  the  DRIMS  CTEA,  for  example,  the  "^lative  training 
effectiveness  (RTE)  factor  was  based  on  overall  probability  f  hit  (Pu), 
since  it  provided  the  most  stable  index  of  rifle  firing  proficiency.  ”rtE  in 
this  case  is  defined  as: 

Overall  ?„  of  the  alternative  training  device 
RTE  =  _ I _ 

Overall  of  the  baseline  M1 5/Ml  93 

RTE  is  an  index  of  the  relative  effectiveness  of  each  alternative  training  de¬ 
vice  with  respect  to  the  baseline  weapon  or  syston.  If  RTE  is  1.0,  an  alterna¬ 
tive  is  equal  to  the  baseline  in  terms  of  training  effectiveness.  If  it  is  less 
than  1.0,  it  is  less  effective  than  the  baseline.  Rank  order  the  alternatives 
based  on  the  RTE  from  highest  to  lowest  (1  to  n) . 

f.  Detenrane  the  cost  of  each  alternative  relative  to  the  base  case. 

RC  =  Cost  of  alternative 
Cost  of  base  case 

Rank  order  the  alternatives  based  on  the  RC  of  each  from  lowest  to  highest 
(1  to  n) . 

g.  Determine  relative  user  acceptance  (RUA).  njser  acceptance  is  an 
important  factor  in  any  decision  to  choose  a  training  device.  Far  too  often 
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devices  remain  in  the  training  room  and  are  never  utilized  due  to  lack  of 
user  acceptance  and  perceived  vadue.  These  attitudes  often  cannot  be  finitely 
evaluated  but  they  must  be  appraised."*  F'rx»  test  or  survey  data: 

=  nuaber  of  trainee  preferring  Alternative  1 
nunber  of  trainers  preferring  base  case 

Rank  order  the  alternatives  baaed  on  the  RUA  of  each  from  highest  to  lowest 
(1  to  n) . 


h.  Add  the  r-euudngs  for  the  four  factors  of  each  alternative.  Deter¬ 
mine  the  overall  rank  order  of  the  alternatives  with  the  most  preferable  alter¬ 
native  having  the  lowest  sm. 

i.  Figure  III-30  is  an  example  of  the  ranking  factors  and  ranking  of 
training  alternatives  from  the  cited  study. 

6.  Analogous  Task  Method 

Having  determined  the  effectiveness  of  two  or  more  analogous  tasks 
(see  paragraph  C3  above),  cocapare  the  training  programs  of  each  on  the  basis 
of  the  proven  effectiveness  of  each  and  the  cost  of  each. 


7.  TECEP 


Having  developed  alternative  training  programs  by  the  procedures  in 
Section  IIIB2  above,  con^are  the  programs  on  the  basis  of  relative  cost  and 
your  judgment  of  their  merits  as  you  work  them  through  the  practicality  test 
in  that  section. 


•DRIMS  CTEA,  p.  46. 


BASELINE  ALTERNATIVES 


RANKING  FACTORS 

Ml  6 

WNEER 

LTRN 

RFA 

RELATIVE  TRAINING  EFFECTIVENESS  (RTE) 

Record  Fire 

1.0 

1.01 

0.99 

1.00 

Relative  Training  Effectiveness  Rank 

(1) 

(1) 

(1) 

(1) 

RELATIVE  COST  (RC) 

a.  Table  4,  Section  V 

1.0 

0.08 

C.05 

0.10 

b.  Relative  Cost  Rank 

(4) 

(2) 

(1) 

(3) 

RELATIVE  CAPABILITY  (RCP) 

a.  Table  IV-I 

1.0 

0.86 

0.50 

0.64 

b.  Relative  Capability  Rank 

(1) 

(2) 

(4) 

(3) 

RELA’-IVE  USER  ACCEPTANCE  (RUA) 

a.  CET  of  Weaponeer  &  Lasertrain 
dated  Oct  77 

1.0 

4.33 

1.0 

0.33 

b.  Relative  User  Acceptance  Rank 

(2) 

(1) 

(2) 

(3) 

TOTAL  OF  RANKINGS  (LOWEST  SCORE  MOST 

COST  AND  TRAINING  EFFECTIVE) 

(8) 

(6) 

(8) 

(10) 

FINAL  ALTERNATIVE  RANKINGS 

(2) 

(1) 

(2) 

(3) 

Figure  III-30.  Ranking  Factors  and  Ranking  of  Training  Alternatives 
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F.  Resolution  of  Issues 


1.  ITV  CTEA  (TRADOC,  Cost  and  Operational  Effect: veness  Analysis  for 
the  Improved  TOW  Vehicle  (I7V) ,  Part  IV,  Cost  and  Training  Effective¬ 
ness  Analysis,  June  1978). 

All  the  issues  you  will  have  to  resolve  in  your  CTEA  cannot  be  pre¬ 
dicted.  For  example,  one  of  the  objectives  of  the  above  cited  CTEA  was  to 
determine  if  it  were  more  cost  effective  to  train  the  system  at  Fort  Banning 
or  at  Fort  Knox.  The  alternatives  considered  were: 

o  Alternative  #1  -  Train  TOWCAP  at  Fort  Knox  and  Fort  Banning. 

o  Alternative  #2  -  Train  ITV  and  ground  mount  at  Fort  Banning. 

o  Alternative  #3  -  Train  ir/  and  ground  mount  at  Fort  Knox. 

o  Alternative  ^^4  -  Train  ITV  at  Fort  Banning  and  TOW  ground  mount 

at  Fort  Knox. 

o  Alternative  #5  ■*  Train  TOW  ground  mount  at  Fort  Berjiing  and  ITV 
at  Fort  Knox. 

For  the  effectiveness  portion  it  wa^;  assumed  that  training  at  Fort 
Banning  and  training  at  Fort  Knox  were  equally  effective.  (You  must  be  very 
careful  in  making  such  assumptions  and  in  all  your  assumptions.)  The  cost 
analysis  showed  that  Alternative  #3  was  the  most  cost  effective  (i.e.,  Fort 
Knox  was  determined  to  be  the  least  cost  training  location  for  the  ITV  and 
ground  mount). 

Normally,  the  system  for  which  your  school  is  the  proponent  will  be 
trained  at  your  school  but  some,  of  course,  will  involve  two  or  more  schools 
as  with  the  TOW.  This  process  method  merely  illustrates  one  way  of  resolving 
the  training  location  issue  as  a  guide  and  reference. 

2.  DRIMS  CTEA  (USAIS,  Diagnostic  Rifle  Marksmanship  Simulators  Cost  and 
Training  Effectiveness  Analysis ,  August  1 97b ) . 

Given  issues  to  resolve  such  as  user  acceptance  and  capability  of 
alternatives  to  teach  recuired  skills,  you  may  be  able  to  resolve  them  as  in 
the  cited  method. 


Use  the  procedure  outlined  in  paragraph  E5  above  ander  ''Comparison  of 
Training  Alternatives"  to  determine  the  relative  ranking  of  alternatives  with 
respect  to  the  issues. 


3.  Trainability  Analysis 


This  method  is  a  way  to  resolve  the  issue  of  trainability  of  tasks. 
First,  compare  task  descriptions  and  training  programs  with  available  data  on 
personnel  characteristics.  On  the  basis  of  this  infonnal  (subjective)  compari¬ 
son,  rate  the  risk  that  a  task  ca.nnot  be  adequately  trained  as  (1)  Hig.h,  (2) 
Moderate,  or  (3-  Low. 
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Compare  the  tasks  with  mission  analyses  or  operational  concepts  and 
rate  the  criticality  of  each  task  to  the  mission  as  (1)  High,  (2)  Moderate,  or 
(3)  Low. 


Construct  a  matrix  such  as  in  Figure  III-31  showing  risk  versus  criti¬ 
cality.  Where  high  risk-high  criticality  tasks  coincide,  great  concern  for 
trainability  is  indicated,  where  moderate  risk-moderate  criticality  tasks  coin¬ 
cide,  moderate  concern  is  indicated;  and  where  low  risk- low  criticality,  high 
risk-low  criticality,  or  low  risk-high  criticality  tasks  coincide  little  or  no 
concern  is  indicated. 
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H  -  HIGH  CONCERN 
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L  »  LOW  CONCERN 


Figure  III-31.  Trainabilicy  Concern  Matrix 


C .  Sample  Procedure 

In  order  to  help  you  tie  the  processes  together  into  a  CTEA,  the  following 
hypothetical  example  exercises  the  general  CTEA  model  that  has  been  discussed. 

Situation 

You  have  been  required  to  perform  a  CTEA  on  a  new  air  defense  system 
(System  X)  that  is  in  its  early  stages  of  development  to  counter  a  short  range 
air  defense  (SHORAD)  threat.  Concurrently,  procurement  of  a  simulator  for 
training  is  being  considered.  The  purpose  of  your  CTEA  is  to  allow  decision 
makers  to  assess  the  training  impacts  of  the  system,  both  as  to  the  estimated 
cost  and  the  estimated  effectiveness  of  training  on  the  system. 

Procedures 

1 .  Assessment  of  Data  and  Choice  of  Strategy 

Using  the  guidelines  of  Figure  II-1,  General  CTEA  Model  (p.  II-2), 
assess  the  available  data.  You  find  you  have  no  training  program  and  no  task 
list  for  the  developing  system.  This  requires  Strategy  1  (p.  II-7),  and  you 
find  you  will  need  to  do  all  the  processes: 

a.  Generate  a  task  list, 

b.  Predict  training  programs, 

c.  Estimate  effectiveness, 

d.  Cost  the  training  programs, 

e.  Compare  the  training  program  alternatives, 

f.  Resolve  issues. 


2.  Generate  a  Task  List 

Table  II- ;  (p.  II-7)  lists  three  methods  for  generating  a  task  list. 
After  reading  Section  IIIA  (starting  on  p.  II-1),  you  decide  the  DIVAD  Gun  ap¬ 
proach  most  nearly  matches  your  situation.  As  an  air  defense  subject  matter 
expert  (SME) ,  you  have  some  familiarity  with  System  X  and  considerable  knowledge 
concerning  air  defense.  You  know,  for  example,  that  the  system  is  a  missile 
system  that  will  employ  new  scanning,  acquisition,  and  tracking  subsystems  that 
are  not  radar.  There  v.dll  be  an  optical  sighting  subsystem  as  backup.  The  mis¬ 
sile  will  have  an  improved  infrared  (IR)  lock-on  capability.  You  also  know  that 
although  there  will  be  an  identification  of  friend  or  foe  (IFF)  subsystem,  vis¬ 
ual  identification  will  be  needed  as  backup.  You  start  to  build  your  task  list: 


o  Perform,  preventive  maintena.nce  checks  and  services  (PMCS)  cn 
the  system. 


o  Perform  troubleshooting  procedures  on  the  system. 


o  Acquire  targets 

o  Track  targets 

o  Engage  targets 

o  Visually  identify  aircraft 

3.  Prediction  of  Alternative  Training  Programs 

The  next  step  is  the  development  of  alternative  programs  to  train  the 
tasks  on  the  list  you  have  drawn  up.*  Consulting  Table  II-1 ,  Column  B,  you  find 
four  suggested  methods  for  predicting  training  programs:  TEEM,  TECEP,  DIVAD  Gur, 
and  ATM.  Since  you  have  generated  a  task  list  and  you  are  familiar  with  earlier 
systems  that  train  similar  tasks,  you  decide  to  use  ATM  to  predict  alternative 
training  programs. 

Three  tasks  —  acquire,  track  and  engage  targets  —  group  themselves 
into  a  set  that  will  be  trained  together.  The  action  verbs  are  on  the  ATM  task 
verb  list.  You  have  found  two  similar  weapon  systems  that  require  that  opera¬ 
tors  be  trained  to  track  a  target  in  a  continuous,  regulatory  movement  and  have 
found  clcse  comparability  among  all  three  systems  on  the  initiating  cues,  cue 
characteristics,  responses  to  cues,  response  characteristics,  and  feedback  cate¬ 
gories  and  characteristics  (see  ATM  example,  III.B.4,  p.  III-21). 

The  next  step  is  to  look  at  the  training  programs  of  these  two  prede¬ 
cessor  systems  —  System  A  and  System  B.  You  find  the  following: 

System  A  teaches  target-related  tasks  in  the  institution.  Crevmen  at 
Level  1  are  instructed  in  a  s chool- taught ,  529-hour  course  without  self-pacing. 
One  instructor  is  assigned  10  students.  The  System  A  POI  schedules  twenty- five 
hours  of  instruction  in  these  skills.  Ammunition  is  allotteo  at  the  rate  of 
.1  System  A  guided  missile  per  student  to  be  used  during  the  five  hours  of  in¬ 
struction  that  takes  place  in  the  field.  The  student  is  expected  to  be  90t 
accurate  to  pass  this  part  of  his  course. 

System  B  trains  target  acquisition,  tracking,  and  engaganent  Ln  a 
moving  target  simulator  in  a  controlled  environment.  Twenty  training  hours 
(two  in  conference  and  18  in  p.^actical  experience)  are  allotted.  The  trainee 
is  expected  to  engage  successfully  80%  of  the  targets  presented.  Thi:>  training 
is  followed  by  five  hour'.s  of  exami.n3tion  tracking  live  targets.  Ammutition  re¬ 
quirements  for  this  task  are  .2  System  B  guided  missile  per  student. 

You  know  that  the  new  system  will  be  taught  in  the  same  type  school 
environmerit  and  be  subject  to  approximately  the  sam.e  course  length  and  facili¬ 
ties.  You  know  fnat  a  sirni^lator  is  being  considered.  Using  the  training  for 
Systems  A  and  B  as  models,  you  car.  now  predict  alternative  programs  for  this 
set  of  tasks  for  System  X.  You  might  present  them  as  follows: 


this  point  on  we  will  use  one  set  of  relrtoc  tasks 
model.  I.n  an  actual  CTBA  you  would,  -f  course,  \;3e  the 


to  illustrate  the  CTEA 
er.‘:ire  task  list. 


Alternative  1 


20  hours  of  classroom  instruction 

5  hours  of  instruction  in  the  field 

1  instructor 

10  students 

1  System  X  guided  missile  per  class 

A  set  of  visual  aids  for  identifying  targets 

Alternative  2 

2  hours  of  classroom  instruction 

Id  hours  of  practical  experience  in  a  moving  target  simulator 

5  hours  of  examination  tracking  live  targets  in  the  field 

1  instructor 

10  students 

2  System  X  guided  missiles  per  class 

4.  Estimate  Effectiveness 

You  must  now  estimate  how  successful  each  of  these  programs  will  be  in 
training  soldiers  to  be  System  X  missile  crewmen.  Unless  the  CTEA  you  are  con¬ 
ducting  takes  place  after  some  field  testing  and/or  production  of  a  prototype 
simulator,  you  will  not  be  able  to  field  test  the  alternative  training  programs 
and  determine  their  relative  effectiveness.  Therefore,  you  can  choose  one  of 
the  methods  recommended  for  Process  C,  Estimation  of  Effectiveness  (TEEM,  DIVAD 
Gun,  ATM,  TRALWICE,  or  TCA,  see  p.  IIX-35  to  III-77).  Since  you  were  success¬ 
ful  in  finding  the  target-related  tasks  taught  in  analogous  systems,  you  will 
probably  continue  to  use  ATM. 

In  the  process  of  predicting  the  training  programs  you  find  90?^  accu¬ 
racy  was  required  for  System  A  trainees  and  SOU  for  System  B.  You  study  the 
historical  data  at  the  school  and  find  that  70%  of  the  System  A  students  and 
85/1  of  the  System  B  students  pass  their  examination  of  this  set  of  tasks  at 
the  end  of  training.  You  now  have  estimates  of  effectiveness  based  on  the 
effectiveness  cf  the  analogous  programs  you  used  to  develop  your  proposed 
alternative. 

5.  Cost  the  Traj.ning  Prograns 

This  analysis  is  taking  place  early  in  the  life  cycle  of  System  X  and 
you  do  not  find  finn  cost  data  available.  You  consider  several  approaches. 

You  decide  that  the  reliability  of  the  data  indicate  that  the  per  student  costs 
of  training  for  Analogous  Systems  A  anc  B  will  be  most  suitable.  You  note  that 
the  cost  of  development  of  the  proposed  training  device  will  be  so  large  as  to 
outweigh  ariy  differences  in  the  operating  costs  of  the  two  programs  so  you  omit 
this  from  your  calculations  leaving  its  assessments  for  the  required  separate 
device  COEA.  You  foresee  no  unusual  training  cost  connected  with  System  X. 
School  historical  data  show  that  it  costs  $800  to  train  each  student  when 
trained  on  System  A  and  $1200,  on  System  3,  You  will  use  these  as  estimated 
costs  for  the  proposed  Alternatives  i  and  2. 


6.  Compare  the  Training  Program  Alternatives 

You  now  have  estimates  of  the  effectivoiess  of  two  programs  designed 
to  train  the  selected  task  and  of  the  institutional  cost  to  train  a  student 
to  perform  the  task.  The  costs  of  the  two  prog’^ams  and  are  on  the  same  basis 
since  you  are  excluding  the  necessarily  high  cost  of  developing  and  purchasing 
a  new  training  simulator.  You  have  chosen  normal  annual  operating  costs. 

Since  you  have  used  the  ATM  for  both  estimates,  this  low  level  of  precision 
indicates  that  you  continue  to  use  ATM  to  compare  the  training  programs.  You 
found  in  your  earlier  assessment  (Par.  and  5)  that: 


A 
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ness  (BXC) 
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(Col.  E  T  Col.  D) 

1 

.70 

.90 

.63 

$  a, 000 

12,698 

2 

.«5 

.«0 

.bb 

$12,000 

17,647 

The  first  program  produces  fewer  but  more  accurate  crewmen  at  the  lower  cost 
per  class.  The  second  produces  trained  students  more  effectively  but  they  are 
less  proficient  and  more  expensive.  On  calculating  the  C/E  you  find  a  lower 
value  for  Alternative  1  and  therefore  can  report  that  it  is  the  more  cost  ef¬ 
fective.  Be  aware,  however,  that  if  a  criterion  level  of  effectiveness  has 
been  established,  you  may  be  spending  money  needlessly  on  effectiveness  that 
exceeds  that  criterion. 

7.  Resolve  Issues 

Some  issues  may  have  been  posed  as  questions  in  your  authorizing  letter 
of  instruction.  For  example,  you  are  asked  to  assess  two  installations,  X  and 
Y,  as  to  suitability  for  live  fire  target  practice.  You  find  that  only  X  has  in 
existence  a  usable  range.  Energy  costs  are  lower  at  Y,  construction  costs  lower 
at  Y,  but  environmental  impact  is  net  favorable. 

Another  issue  you  address  is  trainability.  (You  assess  this  factor 
using  method  in  III.F.3,  p.  III-tB?.)  The  tasks  of  target  acqusition,  tracking, 
and  engaging  are  among  the  most  critical.  On  examination  of  the  personnel  capa¬ 
bilities  and  the  two  analogous  training  programs,  you  find  that  the  majority  of 
trainees  are  trained  to  criterion.  Since  System  X  has  features  such  as  the  new 
scanning,  acquisition,  and  tracking  subsystems  and  improved  IR  lock-on  capa¬ 
bility,  you  have  good  reason  to  believe  that  it  will  be  easier  to  operate  and 
be  more  effective.  Therefore,  although  task  criticality  is  high,  training  risk 
is  judged  low  and  you  report  that  on  tne  issue  of  task  trainability,  there  is 
little  concern. 


—  iligf  fiiiiiMi 


8 .  Prepare  Report 


The  last  step  in  the  CTEA  process  is  the  preparation  of  a  clear,  com¬ 
prehensive,  well-docunented  report  or  the  finaings  with  reconrnendations  as 
warranted. 

Formats  will  vary  but  such  recent  CTEA  reports  as  the  DIVAD  Gun  (1979) 
and  the  U.  S.  ROLAND  Missile  System  (1978)  can  serve  as  models.  You  will  want 
to  refer  to  the  TRADOC  Training  Effectiveness  Analysis  Handbook  as  well. 

Once  completed,  your  report  will  serve  both  as  an  aid  to  decision 
makers  and  also  as  a  basis  or  starting  point  for  all  other  requirements  for 
CTEA  input  during  the  life  of  System  X. 
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ANNEX  A  TEEM 


Appendix  1 

MEDIA  RELATED  VARIABLES 


stimuli  characteristics 

Medium  of  StiniLli  Presentaticr 

1.  Visual  Cues  -  Signals  received  through  the  sense  of  sight, 

2.  Audio  Cues  -  Signals  received  through  the  sense  of  hearing. 

3.  Tactile  Cues  -  Signals  received  through  the  sense  of  touch,  including 
sensations  related  to  texture,  size,  shape,  or  vibration  of  the  skin. 

4.  External  Stimulus  Motion  Cues  -  The  sensations  felt  by  a  person  when 
he  is  moved  by  some  outside  force  in  such  a  way  that  his  body  experiences 
roll,  pitch,  yaw,  heave,  sway  and/or  surge. 

5.  Internal  Stimulus  Motion  Cues  -  The  sensations  felt  by  a  person  when 
he  moves  his  arm,  leg,  fingers,  etc. 

6.  Olfactile  Cues  -  Signals  received  through  the  sense  of  smell. 

7.  Gustatile  Cues  -  Signals  received  through  the  sense  of  taste. 

Visual  Form 

8.  Visual  Alphanumeric  -  Words  and/or  number.'  presented  visually. 

9.  Visual  Svmibolic  -  Symbols  presented  graphically. 

10.  Visual  Graphic  -  Two-dimensional  figures,  such  as  maps,  graphs, 
mathematical  curves,  etc.,  presented  visually. 

11.  Visual  Pictorial  -  Two-dimensional  images,  such  as  photographs, 
drawings,  etc.,  presented  visually, 

12.  Visual  Solid  Object  -  A  three-dimensional  image  or  reality  that  is 
V i ewed  from  exterior oerspectives, 

13.  Visual  Environment  -  A  three-dimensional  image  or  reality  that  is 
V i ewe?  from  inside. 

Visual  Movement 


14.  Visual  Still  -  A  static  visual  field,  as  with  a  still  photograph, 
drawing  or  printed  page, 

15.  Visual  Limited  *1cvement  -  A  basically  static  visual  field  with  ele»wnts 
that  can  be  made  to  mOve,  as  with  an  animated  transparency  or  simple  panel 
with  switcf'es  that  move. 


16.  Visual  Full  Movement  -  A  visual  field  in  which  all  elements  can  move, 
as  wi^  a  motion  picture,  flight  simulator,  or  operational  aircraft. 

17.  Visual  Cyclic  Movement  -  A  visual  field  which  moves  through  a  fixed 
sequence  and  then  repeats  the  sequence  in  a  repetitive  manner,  as  with  a 
film  loop. 

Visual  Spectrum 

18.  Black  and  White  -  A  visual  field  composed  of  either  black  or  white 
elements,  as  with  the  printed  page  or  line  drawings. 

19.  Gray  Scale  -  A  visual  field  composed  of  black,  white  and  continuous 
gradations  of  gray,  as  with  a  black  and  white  photograph  or  television 
picture. 

20.  Color  -  A  visual  vield  composed  of  various  segments  of  the  visual 
spectrum,  as  with  color  television  or  motion  pictures. 

Visual  Scale 

21.  Exact  Scale  -  Actual  visual  field  or  a  one-to-one  replication  of 
that  field  as  with  a  full-sized  mock-up,  simulator,  or  operational  system. 

Proportional  Scale  -  A  rep’^esentation  of  reality  in  other  than 
full  scale,  such  as  a  scaled  model  map  or  photograph. 

Visual  Contrast 

23.  Dini  -  A  visual  object  which  blends  in  with  its  background,  i.e., 
there  is  a  small  or  no  luminance  difference  between  an  object  and  its 
background. 

24.  Bright  -  A  visual  object  which  is  brighter  than  its  background, 
i.e.,  there  is  a  large  luminance  difference  between  an  object  and 
its  background. 

Audio  Sources 

25.  Tonal  Sound  -  A  very  limited  source  of  sound  or  noise  which  is  used, 
rather  than  speech,  for  signaling  or  warning,  e.g.,  horns,  whistles,  sirens, 
bells,  buzzers,  etc. 

26.  Voice  Sound  -  A  limited  source  of  sound  which  enables  spoken  \'«)rds 
to  be  used  as  the  medium  of  communications,  but  not  suited  to  more 
demanding  tasks,  such  as  music  or  sound  recoqnition  exercises. 

27.  Full  Sound  -  A  source  of  sound  that  contains  all  the  significant 
elements  of  the  sound  and  is  suited  to  the  demanding  task  of  sound 
recognition  exercises. 
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28.  Ambient  Sound  -  A  complex  sound  environment  with  sounds  emanating 
from  various  sources  and  from  various  directions,  including  background 
noise  and  task  significant  sounds. 

Audio  Stimuli  Intensity 

29.  Weak  -  Audio  stimuli  presented  to  the  trainee  which  have  weak  intensity. 

30.  Strong  -  Audio  stimuli  presented  to  the  trair.ee  which  have  strong 
intensity. 

Stimuli  Presentation 

31.  Static  -  A  unitary  stimuli  situation,  i.e.,  stimuli  are  presented  to 
the  trainee  "all  at  once",  e.g.,  batch  presentations. 

32.  Dynamic-Ordered  -  A  sequential  stimuli  situation,  i.e.,  stimuli  are 
presented  to  the  trainee  sequentially  or  in  an  ordered  manner  over  time. 

33.  Dynamic- Random  -  A  non-sequential  stimuli  situation,  i.e.,  stimuli 
are  presented  to  the  t*’ainee  ranoomly  over  time. 

Stimuli  Presentation  Rate 

34.  Slow  Rate  -  A  slow  rate  or  speed  of  presentation  of  stimuli  to  the 
trainee,  allowing  the  trainee  a  long  or  maximum  stimulus  analysis  time. 

35.  Fast  Rate  -  A  fast  rate  or  speed  of  presentation  of  stimuli  to  the 
trainee,  allowing  the  trainee  a  short  or  minimum  stimulus  analysis  time. 

Number  of  Charnels  or  Sources 

36.  Limited  -  A  small  number  of  sources,  channels,  or  Instruments 
through'  which  stimuli  are  presented  to  the  trainee. 

37.  Unlimited  -  A  multiple  number  of  sources,  channels,  or  instruments 
through  which  stimuli  are  presented  to  the  trainee. 

Stimuli  Distribution 

38.  Individual  -  All  information  is  presented  directly  to  one  individual 
trainee. 

39.  Group  -  Information  is  presented  to  a  group  of  trainees,  allowing  only 
indirect  access  to  the  information  for  an  individual. 
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MEUIA  RELATED  VARIABLES 


RESPONSE  CHARACTERISTICS 
Response  Mode  of  Implementation 

1.  Overt  Response  -  Verbal  -  A  response  which  the  trainee  expresses  in  an 
audible  (verbal)  manner,  such  as  a  verbal  short  answer  response  to  a  question 
having  a  limited  set  of  correct  answers,  a  conversational  response,  or  a 
verbal  decision  response. 

2.  Overt  Response  -  Written  -  A  response  which  the  trainee  expresses 

in  an  observable  (written)  manner,  such  as  a  free  style  written  response, 
a  written  multiple  choice  response,  or  a  written  fill-in-the  blank  response. 

•  Overt  Response  -  Manipulative  Acts  -  A  response  which  the  trainee  expresses 
in  an  observable  (manipulative)  manner,  such  as  the  small  movements  of  dials, 
switches,  keys,  or  small  adjustments  to  instruments  or  the  large  niovements  of 
levers,  wheels  or  use  of  hand  held  tools. 

4.  Overt  Response  -  Tracking  -  A  response  which  the  trainee  expresses  in  an 
observable  (tracking)  manner,  such  as  continuously  controlling  a  constantly 
changing  system,  e.g.,  steering  an  automobile. 

5.  Overt  Response  -  Procedural  Performance  -  A  response  which  the  trainee 
expresses  in  an  observable  (procedural  performance)  manne*",  such  as 
performing  a  sequence  of  steps  in  a  procedure,  e.g.,  carrying  out  the  items 
on  the  checklist  for  preflighting  an  aircraft  or  turning  on  a  radar  system. 

Intensity  of  Response 

Weak  -  Responses  made  by  the  trainee  with  weak  intensity. 

7.  Strong  -  Responses  made  by  the  trainee  with  strong  intensity. 

Response  Implementation 

Static  -  A  unitary  response  situation,  i.e. ,  responses  are  made  by  the 
trainee  "all  at  once". 

9.  Dynamic-Ordered  -  A  sequential  response  situation,  i.e.,  responses  are 
made  by  the  trainee  sequentially  or  in  an  ordered  manner  over  time. 

10.  Dynamic- Random  -  A  non-sequential  response  situation,  i.e.,  responses 
are  made  by  the  trainee  randomly  over  time. 
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Required  Response  Rate 


11.  Slow  Rate  -  A  slow  rate  or  speed  of  trainee  response,  i.e.,  a  rate  which 
allows  the  trainee  a  long  or  maximum  response  time. 

12.  Fast  Rate  -  A  fast  rate  or  speed  of  trainee  response,  i.e.,  a  rate  which 
allows  the  trainee  a  short  or  minimum  response  time. 

Number  of  Response  Channels 

13.  Limited  -  A  limited  number  of  sources,  channels,  or  instruments  through 
which  required  responses  are  made  by  the  f^ainee. 

14.  Unlimited  -  An  unlimited  number  of  sources,  channels,  or  instruments 
through  which  responses  are  made  by  the'trainee. 

Response  Distribution 

15.  Individual  -  One  individual  trainee  makes  the  required  response. 

16.  Group  -  A  group  of  trainees  make  the  required  response. 
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MEDIA  RELATED  VARIABLES 


INFORMATION  FEEDBACK  LOGIC 
Medium  of  Feedback  Presentation 

1.  Visual  -  Feedback  presented  visually  by  means  of  a  display,  it  mav  be 
coded  and  transmitted  visually  to  the  trainee. 

2.  Aural  -  Feedback  presented  aurally  by  means  of  a  display  to  the  trainee. 

3.  Written  Form  -  Feedback  presented  to  the  trainee  in  written  form. 

4.  Face-to-Face  Communication  -  Feedback  presented  by  direct  verbal  means 
to  the  trainee. 


j.  Indirect  Communication  -  Feedback  presented  by  indirect  verbal  means, 
such  as  by  intercom,  telephone,  or  radio  link. 

6.  Tactile  -  Feedback  presented  to  the  trainee  through  the  sense  of  touch, 
including  sensations  related  to  texture,  shape,  size,  or  vibration  of  the  ski 

7.  Kinesthetic  -  Feedback  presented  to  the  trainee  by  either  internal  or 
external  bodily  movement,  such  as  reaching,  grasping,  tilting,  etc. 

8.  01  tactile  -  Feedback  presented  to  the  trainee  through  the  sense  of  smell. 

9.  Gustati le  -  Feedback  presented  to  the  trainee  through  the  sense  of  taste. 
Source  of  Feedback 

Intrinsic  F  -  Information  or  cues  built  into  the  system  from  which  the 
.rainee  interprets  feedback  information. 


11.  Extrinsic  F  -  Information  or  cues  not  inherent  in  the  trainee  action  or 
system  operations  but  is  supplied  by  an  external  source. 


Type  of  Feedback 


12.  Research  Correctness  (Rcr)  -  Information  about  the  correctness  or 
incorrectness  of  trainee's  response,  when  several  response  alternatives  are 
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(Also  known  as  augmented  feedback.} 


13.  Response  Correctness  (RcfJ  -  Information  provided  to  the  trainee  (or 
others  who  need  to  know  about  his  performance)  that  he  has  in  fact  performed 
an  operation,  but  does  not  say  anything  about  the  longer  range  consequences 
of  the  action  taken. 


14.  Response  Consequences  (Ren)  -  Information  about  the  consequences  of  the 
action  taken.  It  confirms  the  response  made  by  the  trainee,  and  the 
correctness  of  a  response  can  be  inferred  only  from  its  consequences.  May 
also  serve  to  cue  the  trainee  to  perform  tne  next  response  in  sequence. 

15.  System  Status  (Rss)  -  Information  about  the  condition  of  one’s  own 
or  another  system  or  the  external  environment,  on  the  basis  of  which  a 
trainee  or  team  must  act.  Information  is  not  necessarily  (or  even  frequently) 
the  immediate  consequence  of  or  follow-on  to  a  specific  trainee/team  action; 
it  may  reflect  system  events  that  have  been  put  in  motion  by  much  earlier 
trainee  actions.  Provides  information  that  regulates  trainee  and  system 
actions  in  the  sense  that  when  a  particular  status  condition  occurs,  the 
trainee  must  often  take  action  to  maintain  the  int^^grity  of  his  system. 

Feedback  Distribution 


16.  Individual  -  Feedback  is  presented  to  one  individual  trainee. 

17.  Greup  -  Feedback  is  presented  to  a  group  of  trainees,  allowing  only 
indirect  access  for  an  individual. 
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FUNCTIONAL  CONTEXT  VARIABLES 


ROLE  OF  ELEMENT  -  The  social  function  pe;'formed  by  the  trainee  within  the 
system's  operational  context. 

1.  Supervisory  -  The  trainee's  function  is  unequt^.l  to  functions  being 
performed  by  other  individuals;  the  role  is  basically  one  of  overseeing  or 
directing. 

2.  Team  Performance  -  The  trainee's  function  is  equal  to  functions  being 
performed  by  other  individuals;  the  function  is  basically  one  of  teamwork 
and  cooperation. 

3.  Individual  Performance  -  The  trainee's  function  is  one  of  performing 
alone,  usually  without  supervision  or  team  assistance. 

FUNCTION  PERFORMED  IN  ROLE  -  The  primary  actions  performed  within  each  role. ' 

4.  Mental  -  An  action  occurring  or  experienced  in  the  trainee's  mind,  as 
contrasted  with  overt  physical  activity. 

5.  Physical  -  An  overt  bodily  action  performed  by  the  trainee. 

6.  Perceptual  -  An  action  by  tne  trainee  involving  perception  or  observation. 

7.  Communicative  -  An  action  by  the  trainee  in  which  he  transmits  either  a 
written  or  verbal*  message. 

STABILITY  OF  ^UNCTION  -  The  function's  state,  quality,  or  degree  of  being 
constant  overtime. 

8.  Unstable  -  The  trainee's  function  is  not  constant  or  regular,  it  is 
characterized  by  continual  change  and  fluctuation. 

9.  Stable  -  The  trainee's  function  has  little  change  or  fluctuation  over  time. 

■PHYSICAL  CONTEXT  -  The  significance  of  the  physical  environment  upon 
performance  of  the  task. 

10.  Low  Impact  -  The  physical  environment  has  little  or  no  significant 
impact  on  performance  of  the  task. 

11.  High  Impact  -  The  physical  environment  has  a  large  or  significant  impact 
on  perTbiinance  of  the  task. 

PSYCHOLOGICAL  IMPACT  -  The  significance  of  the  psychological  environmecw 
upon  performance  of the  task. 


,2.  ,  ..pact  -  The  psychological  eovlron^ent  has  little  or  no  significant 

impact  on  performance  of  the  tas. . 

13.  Mich  l-pact  -  The  psychological  environment  has  a  large  or  significant 
impact  on  performance  of  the  task. 
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TRAINING  EQUIPMENT  R  MATERIALS 


Visual  Only  Systems 

1.  Case  Study  Folders  -  Folders  with  illustrative  studies  showing  cause 
and  effect  information,  may  include  pictures,  graphs,  maps,  charts,  etc. 

2.  Flash  Cards  -  A  set  or  deck  of  cards  designed  to  present  information 
to  a  group  or  individual  student. 

3.  Printed  Materials  -  Handouts  -  Handouts  are  a  class  of  printed 
materials  issued  to  a  student  for  his  use  and  retention  to  augment  regular 
instructional  materials.  They  are  usually  instructor  prepared,  machine 
copied  materials  of  one  or  two  pages  highlighting  specific  topics  or 
updating  existing  materials. 

4.  Printed  Materials  -  Performance  Aids  -  Performance  aids  are  a  class 
of  printed  materials  that  display  data  to  aid  in  job  performance  or  to 
identify  facts  or  background  information.  They  include  conversion 
tables,  data  charts,  schematic  diagrams,  equipment  test  tolerance  matrices, 
checklist  routines,  maps,  and  the  like. 

5.  Printed  Materials  -  Reference  Books  -  Reference  books  are  a  class  of 
printed  materials  used  to  identify  certain  fncts  or  for  background 
information  such  as  dictionaries,  encyclopedias,  technic(il  publications, 
guides  or  manuals. 

6.  Printed  Muterials  -  Workbooks  and  Exercises  -  A  class  of  printed 
materials  used  to  aunment  or  replace  instructional  texts  by  providing  a 
mix  of  text  information  and/or  practice  exercises  and  quizzes. 

7.  Printed  Materials  -  Textbooks  -  Textbooks  are  a  clr-'ss  of  printed 
material  dealing  with  a  subject  of  study  and  used  as  a  principal  source 
of  organized  information. 

8.  Programmed  Text  -  A  printed  text  containing  frames  of  information, 
either  in  the  form  of  questions  requiring  the  trainee  to  construct  simple 
written  responses,  multiple  choice  questions,  etc.  The  material  is 
carefully  sequenced,  tested,  and  revised  to  ensure  that  a  specific  student 
population  will  achieve  stated  behavioral  objectives  with  a  predetermined 
level  of  success. 

?.  Filmstrip  Projection  System  -  A  single  frame  projector  or  attachment 
thereto  that  will  accept  a  filmstrip  format  and  project  the  film 
images  upon  a  viewing  screen. 

10.  Microform  -  Microimaoery ,  such  as  microfilm,  used  as  a  medium  of 
instruction. 
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Overhead  Projecticn  System  -  A  systen  co-isistinn  of  a  horizontal 
staqe  projector  designed  to  use  a  vertical  thrcv;  for  focusing  an 
enlarged  transpaiency  image  upon  a  projection  screen. 

Slide  Projector  System  -  2"  x  2"  -  A  class  of  single  frame  picture 
projectors  that  v/ill  accept  a  standard  2"  x  2"  slide  and  project  the 
contained  image  upon  a  vievnng  screen. 

Audio  Only  Systems 

13.  Audio  Disc  System  -  An  audio  system  that  uses  a  record  player  and 
sound  recorded  on  a  disc  (record). 

14.  Audio  Tape  System  -  An  audio  system  that  uses  a  tape  recorder/ 
reproducer  to  record  sound  on  magnetic  tape. 

15.  Language  Laboratory  -  Aud'^o  -  An  audio  presentational  device  that 
distributes  audio  inforniation  via  a  control  console  to  student  stations 
equipped  with  headsets,  and  may  have  a  microphone  for  console/instructor- 
student  intercommunication  and  a  tape  recorder.  Student  may  interact 
with  taped  instructional  material,  rewind  and  play  back  or  store  responses. 
Student  responses  may  be  monitored  or  recorded  at  console. 

16.  Radio  System  -  A.M/FM  -  A  passive  audio  system  consisting  of  a 
broadcast  studio,  transmTttinn  station,  and  student  radio  receivers. 

The  system  uses  designated  AM/FH  frequency  bands  for  information 
transmission. 

17.  Radio  System  with  Responders  •  A  multi-channel  two-way  radio 
communication  system  that  operates  within  UHF  or  VHF-FM  frequency  bands 
limiting  broadcast  ranges,  fletwork  may  be  open  or  use  encodinn/ 
decoding  techniques  or  responders  for  individual  channel  privacy. 

18.  Telephone  System  -  A  telephone  system  with  switching  matrix 
capability  that  allows  multiple  station  t.vo-way  audio  communication 
at  two  or  more  remote  locations. 


Audio-Visual  Systems 


19.  Carrel  -  A  small  enclosure  or  alcove  incorporating  a  desk,  can 
be  used  by  one  or  two  trainees  and  can  be  equipped  with  AV  equip¬ 
ment  or  tools  or  print  materials  or  a  combination  of  these. 

20.  Dial  Access  Information  Retrieval  System  -  Audio/Vldeo  -  Dial 
access  information  retrieval  is  an  electronic  system  for  distributing 
audio  and/or  visual  materials  and  programs  which  are  stored  in  a 
location  remote  from  where  they  are  dialed  and  received. 

21.  Filmstrip  Projection  System  with  Audio  -  A  sound  filmstrip 
projector  represents  a  family  of  audio-visual  devices  using  single 
frame  visual  filmstrips  with  sound  or  magnetic  tape  or  records. 

Visuals  and  sound  may  be  manually  or  automatically  synchronized. 

Commercial  equipment  options  include  front  or  rear  screen  projection, 
remote  and  stop  action  capability,  and  cartridge  loading  models. 

22.  Microform  with  Audio  -  Microimagery,  such  as  microfilm,  used  as  a 
medium  of  instruction  with  audio  tape  or  disc,  etc. 

23.  Motion  Picture  Projection  System  -  16MM  and  Super  8MM  Films  - 
A  motion  picture  projection  system  using  professionally  or  locally 
prepared  16nim  or  S-8mm  sound  motion  picture  films  for  training. 

App.-opriate  16ttin  or  S-8mm  projector  and  projection  screen  are 
included. 

24.  Sound  Slide  Projection  System  -  A  system  for  presenting  infor- 
matioFTiy  means  of  an  audio  tape  and  a  series  of  synchronized 
projected  visual  slides. 

25.  Teaching  Machine  -  Still  Visual/Audio  -  An  individualized  instruction 
system  composed  of  programmed  instruction  still  frames,  such  as  large 
step  multiple  choice  or  fixed  linear  sequence,  and/or  synchronized  sound, 
and  a  manually  controlled  device  to  display  the  audio  and/or  visual 
information. 

26.  Teaching  Machine  -  Motion  Visual/Audio  -  An  individualized  instruction 
system  composed  of  programmed  instruction  motion  frames,  surn  as  large 
step  multiple  choice  or  fixed  linear  sequence,  and/or  synch.onized 

sound,  and  a  manually  controlled  device  to  display  tne  audio  and/or 
visual  information. 

27.  Teleyideo  Sys':em  -  A  telecommunication  system  that  allows  audio 
and  visual  two-way  conmunication  between  two  or  more  remote  locations. 
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28.  Television  -  Cable  (CATV)  -  A  hybrid  CCTV  system  offering  selective, 
multi^e  channel,  encoded  programming  to  cable  network  patrons.  A 
typical  system  consists  of  a  signal  receiving  antenna  system  for  the 
master  station  and  rela.v  of  amplified  signal  channels  via  area  substations 
to  system  subscribers.  PrograiXiing  may  also  be  generated  and  transmitted 
between  substations  offering  multiple  options  for  conference  or  training. 
Programs  are  encoded  for  privacy  and  control  of  viewing  audience. 

29.  Television  -  Cartridge  (CTV)  -  A  cartridge  television  system  (CTV) 
consists  of  packaged  video  tape  programs,  video  recorder,  playback 

and  display  units,  and  control  equipment  offering  high  selectivity 
and  availability  for  individualized  programming.  Program  cartridges 
may  be  prerecorded,  locally  produced,  or  recorded  off-the-air. 

30.  Television  -  Closed  Circuit  (CCTV)  -  CCTV  is  an  electronic  transmission 
system  for  images  and  sound  using  a  coaxial  cable  distribution  system. 

System  design  induces  one  or  more  studios  or  control  rooms,  a  signal 
distribution  center,  and  signal  distribution  cables  terminating  in 
reception  areas  equipped  with  receiver/monitors.  Off  air,  live  or 

video  taped  programs  may  be  used. 

31.  Television  -  Non-Magnetic  Video  Disc  Svstem  -  An  experimental 

form  of  television,  similar  in  function  to  cartridge  television,  in  which 
the  program  is  encoded  on  a  thin  plastic  disc,  distributed  to  users  where 
it  is  rotated  at  high  revolutions  per  minute  on  a  player  which  reads 
the  data  and  sends  program  signals  into  the  antenna  terminals  of  a 
standard  color  television  receiver.  Random  access  capability. 

32.  Computer  -  A  programmable  electronic  device  that  can  store,  retrieve, 
and  process  data.  It  may  manage  and  display  information  to  a  student, 
accept  student  responses,  provide  feedback,  perform  calculations,  etc. 

33.  Demonstrator  -  A  low  fidelity  simulator  that  demonstrates  manipulative 
principles,  movement  in  time  or  space,  steps  of  a  procedure,  etc. 

34.  Mock-up  and  Panel  -  A  training  aid  used  to  demonstrate  relative 
shape,  size,  composition  or  function  of  an  object  or  system  display. 

It  may  have  moving  parts,  such  as  dials,  switches,  levers,  etc.,  or  have 
non-moving  parts,  such  as  cutaway  or  layout  models,  etc. 

35.  0pe>'::tior.al  Eouipment  -  A  unit  of  or  the  entire  equipment  used  on 
the  job  for  training  purposes  where  extreme  fidelity  is  required. 

36.  Physiological  Trainers  (Hostile  Environment)  Auditory  -  training 
devices  designed  To  place  control leci  stress  on  the  hui".an  hearing  system 
throuij.;  use  of  a  physiological  1  y  and/ur  pbyc^oicgically  adverse  sound 
environment,  to  enable  a  trainee  to  learn  to  function  in  this  adverse 
environment. 
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37.  Physiological  Trainers  (Hostile  Environment)  Visual  -  A  training 
device  designed  to  place  controlled  stress  on  the  human  visual  system, 
through  the  use  of  physiologically  and/or  psychologically  adverse  or 
low  threshold  visual  signals,  to  enable  a  trainee  to  learn  to  function 
in  this  adverse  environment. 

38.  Physiological  Trainers  (Hostile  Environment)  Surface  and  Internal 
Senses  -  A  broad  category  of  training  devices  designed  to  provide  the 
cutaneous,  kinestnetic  and  olfactory  sensors  with  physiologically  and/ 
or  psychologically  adverse  signals,  to  enable  a  trainee  to  function 

in  adverse  pressure,  temperature,  pain  or  disorientating  motion  environ¬ 
ments. 
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Training  Methods 


1.  Lecture-Standard:  A  semiformal  discourse  in  which  the  instructor  presents 
a  series  of  events,  facts,  concepts,  or  principles;  explores  a  problem;  or 
explains  relationships.  Trainees  participate  in  a  lecture  mainly  as 
listeners.  A  lecture  is  basically  a  means  of  "telling"  trainees  information 
they  need  to  know.  Not  all  talking  done  by  an  instructor  during  a  class 
period  can  be  termed  a  lecture,  the  term  desciibes  a  more  formal  presentation 
used  to  achieve  an  instructional  objective. 

2.  Lecture-Team  Teach:  A  semiformal  discourse  in  which  two  (or  more)  instructors 
present  a  series  of  events,  facts,  concepts,  or  principles;  explore  a  problem; 
or  explain  relationships.  Trainees  participate  in  a  lecture  mainly  as 
listeners.  A  lecture  is  basically  a  means  of  "telling"  trainees  information 
they  need  to  know.  Not  all  the  talking  done  by  the  instructors  during  a  class 
period  can  be  termed  a  lecture,  the  team  describes  a  more  formal  presentation 
used  to  achieve  an  instructional  objective. 

3.  Conference-Directed  Discussion:  Group  discussion  techniques  are  used  to  reach 
instructional  objectives.  These  techniques  include  questions,  answers,  and 
corments  from  the  instructor  in  combination  with  answers,  comments,  and 
questions  from  the  trainees,  and  are  directed  toward  attainment  of  learning 
goals.  The  objective  in  directed  discussion  is  to  help  trainees  acquire 
better  understanding  and  the  ability  to  apply  known  facts,  principles, 
concepts,  policies,  or  procedures,  cr  to  provide  trainees  with  an  opportunity 
to  apply  their  knowledge.  The  function  of  the  instructor  is  to  guide  the 
discussion  in  such  way  that  the  facts  principles,  concepts,  or  procedures 
are  clearly  articulated  and  applied. 

4.  Conference-Seminar:  Group  discussion  techniques  are  used  to  reach  instruc¬ 
tional  objectives.  These  techniques  include  questions,  answers,  and  comments 
from  the  instructor  in  combination  with  answers,  comments,  and  questions  from 
the  trainees,  and  are  directed  toward  attainment  of  learning  goals.  The 
purpose  of  the  seminar  is  to  find  an  answer  to  a  question  or  a  solution  to  a 
problem.  The  Instructor  does  not  have  an  answer  or  solution;  in  fact  there 
is  no  known  best  or  correct  solution.  Rather,  he  is  seeking  an  answer,  <ind 
he  uses  the  group  to  develop  one.  The  primary  functions  of  the  instructor 
are  to  describe  the  problem  as  he  understands  it  and  to  encourage  free  and 
full  participation  in  a  discussion  aimed  at  (1)  identifying  the  real  problem, 
(2)  gathering  and  analyzing  data,  (3)  formulating  and  testing  hypotheses,  (4) 
determining  tnd  evaluating  alternative  courses  of  action,  (5)  arriving  at 
conclusions,  and  (b)  making  recommendations  to  support  or  arrive  at  a  solution 
or  a  decision. 
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5.  Demonstration:  The  instructor  actually  performs  an  operation  or  does  a  job, 
thereby  showing  the  trainee  what  to  do  and  how  to  do  it;  he  then  uses 
explanations  to  point  out  why,  where,  and  when  it  is  done.  Usually,  the 
trainee  ir.  expected  to  be  able  to  repeat  the  job  or  operation  after  the 
demonstration. 

6.  Performance-Manual-Independent  Practice:  A  method  in  which  the  trainee  is 
required  to  perform  under  controlled  conditions,  the  operation,  skill,  or 
movement  being  taught.  Performance  is  learning  by  doing.  In  independent 
practice,  trainees  work  individually  and  at  their  own  rate. 

7.  Performance-Manual-Student  Tutor:  A  method  in  which  the  trainee  is  required 
to  perform  under  controlled  conditions,  the  operation,  skill,  or  movement 
being  taught.  Performance  is  learning  by  doing.  In  the  student  tutor 
method,  trainees  are  paired  and  members  of  each  pair  perform  alternately  as 
instructor  and  trainee. 

8.  Performance-Manual-Group  Practice:  A  method  in  which  the  trainee  is  required 
tc  perform  under  controlled  conditions,  the  operation,  skill,  or  movement 
being  taught.  Performance  is  learning  by  doing.  In  group  performance,  a 
group  of  trainees  perform  an  operation  or  function  involving  teamwork. 

9.  Performance-Manual-Group  Controlled  Practice:  A  method  in  which  the  trainee 
is  required  to  perform  under  controlled  conditions,  tne  operation,  skill,  or 
movement  being  taught.  Performance  is  learning  by  doing.  In  group  controlled 
practice,  trainees  work  together  at  the  rate  set  by  the  instructor,  step  by 
step  and  "by  the  numbers". 

10.  Programmed  Instruction:  A  method  of  self-instruction  in  which  the  trainee 
works  through  a  carefully  sequenced  and  pretested  series  of  steps  leading 
to  the  acquisition  of  knowledge  or  skills  representing  the  instructional 
objectives.  The  trainee  proceeds  through  the  program  at  his  own  rate, 
responds  actively  (or  covertly)  to  each  step  in  the  sequence,  and  receives 
immediate  feedback  on  the  correctness  of  his  response  before  proceeding  to 
the  next  step.  Programs  are  usually  designed  to  permit  the  trainee  to 
master  the  desired  knowledge  or  skills. 

11.  Study  Assignment-Individual  Study:  In  the  study  assignment  method,  the 

Instructor  assigns  readings  in  books,  periodicals,  manuals,  or  handouts; 
requires  the  completion  of  a  project  or  research  paper;  or  prescribes 

problems  and  exercises  for  the  practice  of  a  skill.  In  independent  study, 

the  trainee  carries  out  the  assignment  without  instructor  assistance  or 
direct  guidance. 

12.  Study  Assignment- Superviss d  Study:  In  thn  asaitmmenr  method,  the 

instructor  assigns  readings  in  books,  periodicals,  manuals,  or  handouts; 
requires  the  completion  of  a  project  or  research  paper;  or  prescribes 

problems  and  exercises  for  the  practice  of  a  skill.  In  supervised  study, 

the  trainee  carries  out  the  assignment  with  an  instructor  available  for 
guidance  and  assistance. 
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13.  Tutoring:  An  instructor  works  directly  with  an  individual  trainee.  The 
method  may  involve  exposition,  demonstration,  questioning,  coaching,  or 
guided  practice. 

14.  Case  Study:  Involves  in-depth  group  discussion  of  real-life  situations.  It 
requires  reading,  study,  analysis,  discussion,  and  free  exchange  of  ideas  as 
well  as  decision  making  and  the  selling  of  decisions  to  others.  A  case  report 
is  distributed  to  trainees.  The  report  contains  a  factual  and  accurate  picture, 
based  on  firsthand  observation,  of  a  situation  that  portrays  people  acting, 
interacting,  and  reacting.  Trainees  study  the  case  report  and  discuss  it  in 
depth. 

15.  Incident  Method:  A  variation  of  the  case  method  in  which  only  a  brief  sketch 
of  the  climax  of  a  case  is  presented.  Trainees  are  given  a  few  minutes  to 
study  the  incident  and  attempt  to  determine  the  information  they  need  to  find 
out  what  is  going  on.  Trainees  then  get  these  facts  by  asking  questions  of 
the  leader.  Time  is  usually  limited,  and  questions  must  be  of  the  type  that 
can  be  answered  "yes"  or  "no",  or  by  a  simple  factual  r.tatement.  The  group 
then  determines  the  nature  of  the  problem  and  the  decisions  needed  to  solve 
it.  Each  member  writes  an  individual  decision  with  supporting  reasons.  Group 
discussion  of  the  case  in  general  and  the  decisions  reached  follows. 

16.  Role  Playing:  A  laboratory  method  of  instruction  that  involves  the  sponaneous 
dramatization  or  acting  out  of  a  situation  by  two  or  more  persons  under  tha 
direction  of  a  trainer.  The  dialog  grows  out  of  the  situation  developed  by 
the  trainr.es  assigned  to  the  parts.  Each  person  acts  his  role  as  he  feels  it 
should  be  played.  Other  trainees  serve  as  observers  and  critics.  Following 
the  enactment,  the  group  engages  in  discussion. 

17.  Sensitivity  (Laboratory  or  T-Group)  Training:  A  deliberate  effort  to  apply 
behavioral  science  to  problems  of  motivation,  communication,  problem  solving, 
and  teamwork.  Basically,  sensitivity  training  is  small-group  interaction 
under  stress  in  an  unstructured  group  composed  of  learners  and  a  trainer.  The 
objective  is  behavioral  change.  To  attain  the  objective,  a  permissive  or 
supportive  environment  is  established  by  the  trainer.  Participants  are 
encouraged  to  act  their  own  roles,  receive  feedback,  examine  their  concepts 

of  self,  experiment  with  and  practice  new  patterns  of  behavior,  and  learn 
how  to  maintain  changed  behavior  back  on  the  job. 


Games:  Games  include  a  set  of  structured  decision-making  tasks  typical  of  a 
real-life  situation  and  provide  a  systematic  means  of  observing  and  evaluating 
trainees'  decisions.  These,  then,  are  fed  back  to  the  trainees  sc  that  they 
can  judge  their  appropriateness.  Most  games  are  played  by  me  or  more  teams, 
each  composed  of  from  one  to  twenty  participants.  There  may  or  may  not  be 


r'.ois-i  ar*  ^nrarval 


of  time  which  may  represent  a  month,  a  quarter,  or  a  year.  Trainees  are  given 
information  in  the  form  of  reports  or  a  scenario  and  allowed  time  to  study  Che 
situation  and  make  decisions.  These  decisions  are  processed  either  by  a 
control  grouj  of  judges  or  by  a  computer.  The  resulting  data  or  scenario 
projections  are  returned  to  the  team  for  analysis,  and  another  decision. 


A-6-3 


19.  In-Basket  Exercises'.  The  in-basket  situation  is  composed  of  a  representative 
sample  of  a  full  year's  performance  in  all  aspects  of  a  job.  Trainees  are 
given  background  materials,  organization  charts,  policy  manuals,  financial 
statements,  reports,  and  position  papers  to  study  before  the  exercise  begins. 
Each  trainee  is  then  exposed  to  a  structured  array  of  memos,  reports,  letters, 
telephone  calls,  visits,  and  meetings.  In  his  role  as  a  manager,  the  trainee 
makes  decisions  on  the  incoming  "mail."  In  each  Instance  he  commits  himself 
in  writing  to  specific  courses  of  action.  Time  limits  are  established  to 
introduce  realism  and  cause  stress.  Tb.e  decision-making  phase  is  followed 

by  discussion  and  critique  of  the  actions  taken  and  decisions  reached.  All 
actions  are  analyzed,  evaluated,  and  fed  back  to  participants. 

20.  Brainstorming:  A  small,  carefully  selected  group  is  given  a  "how  to"  question 
or  problem  and  is  asked  to  produce  as  many  ideas  or  solutions  as  they  can 
generate.  Usually  a  time  limit  is  set.  The  technique  of  free  association  is 
encouraged.  Quantity  of  ideas  or  solutions  takes  precedence  over  quality. 
Judgments  about  the  worth  of  ideas  or  solutions  are  deliberately  postponed 
until  a  later  time.  Ideas  are  written  on  a  chalkboard  or  flip  chart  as  fast 
as  they  are  called  out. 

21.  Committees:  A  group  of  trainees,  ranging  in  size  from  three  to  seven,  is 
given  a  special  assignment  in  the  form  of  a  problem.  The  group  is  asked  to 
investigate  the  problem,  reach  conclusions,  and  recommend  a  solution  or  a 
course  of  action.  The  committee  may  produce  a  report  which  is  often  presented 
orally  to  the  larger  group. 

22.  Field  Trips:  A  carefully  planned  visit  or  tour  to  a  place  away  from  the  train¬ 
ing  activity.  The  purpose  of  the  trip  is  to  provide  firsthand  observation  of 
objects,  processes,  operations,  and  situations  not  tran.s  port  able  to,  or 
reproducible  in,  the  training  facility.  The  field  trip  may  take  less  than  an 
hour  when  it  involves  a  visit  to  an  adjoining  plant,  office,  or  shop:  or  it 
may  consume  several  days  or  weeks  as  would  be  the  case  with  a  visit  to  a 
distant  plant  or  an  overseas  Installation. 

23.  Panels:  Three  to  ten  people,  under  the  direction  of  moderator,  present  their 
views  on  a  particular  subject  or  problem,  or  present  assigned  phases  of  a 
broad  tooic.  Usually,  panelists  represent  different  kinds  of  expertise, 
experience,  or  perspectives.  Often  they  are  drawn  from  operating  and  staff 
elements.  At  times  experts  from  outside  the  enterprise  are  invited  to 
participate.  Sometimes  trainees  themselves  serve  as  c/embers  of  panels. 
Following  the  presentations  by  the  panelists,  trainees  are  encouraged  to 
participate  through  questions  directed  to  individual  panelists. 
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).  tCMOkrOlMO  kakavtac. 

1.  Uattay  aMuatclM  lata 

arttllarr  ylacM  at  i” 

yvM. 

l«ta 

li(U 

Ittcla  caM  far  «atU- 
ctaa  at  tcBaaattaa. 

Vrtw 

A.  AMaaactc  kakavtar  • 
laa  laaal  af  attaatUa 

U  caaatrak  la  aklllaO 
afaratar.  UaaackftU 
eaaa  Oaataaca  cMiral  at 
kakavtar. 

}.  fatikaa  ar  karaOM  aak 
kaaaaa  a  factar  mm 
akttl  ia  aarfatwa  avar 
m  astaakaa  fa^'aO 
ttM  ar  ac  a  raaU  rata. 

a.  rtM  calarvacM. 

7.  OftM  a  eaaaaaaac  at  a 
Ur(ar  taaa. 

>.  fatactay  •  kavM  yatattay 
ar  yraaarvtay  akty  kali, 
ate. 

y.  Nartklay  •  claaa  artar 
trill. 

B-1-3 


TAEG  Report  No.  16 


Table  B-1-1 


Tmn  mu  or  uutrao  «uatnw«  vtn  m  dOAcrnurics 
or  monM  oanermi  im  wmvn  (ewtiwMO) 

(IM  ttH  BapMt  23  far  aataal  alaarlttM) 


Caaptr 

Tattify 


1.  Ctataraa  taktkiltlat  a 
fattaca  af  kakavlar 
aaaalataat  with  aa 
•etlsaOi  at  «Uat. 

2.  Jaaeam  ailllataaaii  ca 
rarfata  xaatOlat  ta  a 
k(4u>i!tT4  aa  ayyaaa*  ta 
aUXl  ta  yatfaia  aacrrO* 
la(  ca  eaac  ataaaatO. 
(natal  A  pataaa  aaa 
kaaa  a  kl«k  Unal  af  aklll 
ktw  akaaaa  aat  ta  parfaia 

'  ta  a  akillf. t  aaaaar.) 

3.  Caaaaiaa  lata(ratlai  ar 
artaaltiai  a  aalaa  ar 
aCtlnAa  lata  a  aatcara 
af  kahavtar. 


1.  Caaalylai  «<th  kaMat  aafacy 
acaafarAa  ahtla  rar<A»lM 
a  aatataMOa  pracafara  aa 
a  kl«fc  valuta  ai^rly  la  a 

ra4ar  aat. 

2.  Caafatalat  M  tka  auaiatf 
af  kaaftat  aaa'a  kuak  araa 
aaat  aaO  claaa  vkaa  tka 

atrarraalty  aalata  u  Aa 
atkatvlaa. 

1.  AklAlat  ky  aaeatlty  ra|a- 
lactaaa  «haa  kaaAllat 
alaaalftaA  lafaraatlaa. 

A.  Aaeayclat  tka  Mat  M  taka 
rtaka  aaaaaaaty  ca 
ytataec  tka  Uvaa  af 

3.  CaJtlylat  vttk  a  raaaaac 
M  raralt  a  aalfiaacctaalat 
caAla  ctnalc  »tck  traatar 


vatak  taaraaaa  ta  raaaltaA 
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Table  B-2-1 

INSTmCTIOML  OaiVERV  SYSTEM  CHART  FOR  THE  ALGORITHM 


RECAUlNa  BODIES  OF  KNOWIEOOE 


T«  akM**  •  4«it««ty 
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ayttaaa  (taiaMal  ckat 
ka«a  aa  *1*  la  aaah  raa 
«att«aata4  ky  a  V- 
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latCfaatiaa  ri  aaay  taaattaaa 

•  Ia4tvi4aal  TralaMa  aitk  Ia4aaaa4att 
laatiaatti.a  at  Aay  katatIM 

•  (Mil  «aaaa 

•  taata  Ctaar  at  a  (ta«<a  kaaatlaa 

•  *•'»  kattia* 


I  gniMiH|ni| 


•  (tta  a(  eaaaaaaata  aa«  tyaklal  kata* 
aaaa  kaaatayaaat 

Maal 

Caat'al 

•  aaaattaaa  at  kaaatattt«t  CMt 
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Table  B-2-2 

INSTRUCTIONAL  OaiVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


MMM  VOMA..  l^draMATION 
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Table  B-2-3 

INSnUCTlONM.  DaiVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 

KULE  miHIH  AND  U«N« 
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Table  B-2-A 


INSTRUCTIONAL  OaiVERY  SYSTEM  CHAITT  FOR  TME  ALGORITIM 

MAKING  OeCISIONS 
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Table  B-2-5 

INSTRUCTIONAL  DELIVERY  iiVSTEM  CHART  FOR  THE  ALGORITHM 


DETECTINC 


Inal  r:  Oalivacy  syataaa 


To  okooaa  a  kailaacy 

ayataai 

1.  flaea  a  V’  (llyht 

yaaell)  la  baaaa 
cartaaaatla«  atltacla 
(ia«a)  that  aaat  ba  sat 

2.  ialaat  tha  dallvacy 

ayataaa  (aalaaaat  that 
ba«a  aa  *!•  la  aaah  tea 
baalfaatab  by  a  . 
Thaaa  ata  tha  eaablbata 
adtllvacy  ayataaa. 


Dallvaty  hypraaehaa 
batalttlaf  tha  hpplleatlea 
of  All  laafalhf  Culdallaaa 
aad  Alfacltha 


Oallvaty  hppceachaa  NOT 
Patalttlny  Ceaplata 
kpplteatlea  sf  laatnlny 
Culdallnai  and  hlyarltha 


Ccltarla  fat 
talactltd 
laattwctlaaal 
Dallvaty 

Syatadt 


Stksalitt  Ctitatlt 

•  rail  Vtdwdl  lavltaaaaat 

•  tall  babtant  taaadt 

•  latataal  Itlaalaa  Mtlaa  Caaa 
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Itcbaall 
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«lkta 

at  Cevtaaatta  aad  Spdatal  batd- 

laaal 

Cantral 

•  aapai 

L«w 

Ntph 
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Table  B-2-6 

INSTRUCTIONAL  OaiVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 

CUSSIFYING 
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Table  B-2-7 


INSTRUaiONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


lOENTIFYINO  GRAPHIC  SYMBOLS 
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ANNEX  C 
APPENDIX  1 

TASK  VERB  LIST 


Verb 

Definition^ 

Category 

Accomplish 

Complete 

General 

Accunulate 

a  -  Collect  (a) 

15 

b  -  Add 

1 

Achieve 

Complete 

General 

Acknowledge 

a  -  Answer  (a)^ 

7,8,9 

b  -  Answer  (b) 

4 

Acquaint 

Inform 

7,8 

Acquire 

a  -  Detect,  identify  and  locate  a  target  in 
sufficient  detail  to  permit  the  effe<;tive 

employment  of  weapons.# 
b  -  Position  tracking  apparatus  of  a  weapon 
system  so  that  a  designated  target  is 

4,12 

tracked.# 

12 

Activate 

Give  power  to  equipment  so  that  it  may 

begin  to  operates 

10 

Adapt 

Modify  to  fit  a  new  use 

3 

Add 

Perform  the  mathematical  operation  of 

combining  nunbers  into  a  sum 

1 

^All  definitions  have  been  checked  against  Webster’s  New  World  Dictionary, 
Second  College  Editic..,  Cleveland,  Ohio:  William  Collins  +  World  Publishing 
Co.,  Inc.,  19‘^6.  Those  definitions  designated  by  a  section  mark  (§)  are  not 
found  in  this  dictionary  but,  in  Litton *s  opinion,  are  used  with  sufficient 
frequency  to  warrant  inclusion  in  the  list.  Definitions  desipiated  by  #  are 
from  AR  310-25,  Dictionary  of  U.  S.  Army  Terms. 

The  definition  of  categories  1-15  are  given  in  Appendix  C  along  with  the 
synonym  relationships  afflor.g  the  words  in  each  category;  the  synonym  relation¬ 
ships  among  words  in  the  "General*'  category  are  given  in  Appe^ix  A. 

^Many  action  verbs  indicate  the  process  of  information  tr^sfer  without 
reference  to  the  means  of  transfer.  These  verbs  are  appropriate  both  to 
categories  7  and  8.  These  verbs  may  also  be  app.*X)priate  to  category  9 
although  signaling  is  net  usually  appropriate  to  the  communication  of  large 
quantities  of  information  or  fine  detail.  To  classify  a  particular  task  when 
these  verbs  are  used,  you  cjust  also  determine  the  coonunloation  process. 


C-'.-l 


Verb  Definition  Category 


Adjust  a  -  Manipulate  controls,  levers,  linkages  and 

other  equipment  items  to  return  equipment 
from  an  out-of-tolerance  condition  to  an 
in-tolerance  condition  11 

b  -  Adapt  (usually  used  with  3 

Advise  Inform  7,8 

Alert  Inform  designated  persons  that  a  certain 

condition  exists  in  order  to  bring  them 
up  to  a  watchful  state  in  which  a  quick 
reactiai  is  possible  7,8,9 

Align  Adjust  controls  to  match  visual  indicators, 

such  as  pointers,  lines  of  sight,  wave 

forms,  or  aural  signals,  until  coincidence 

is  achieved  1 1 

Alter  Modify  the  method  of  operation  or  some 

component  of  a  unit  of  equipment  General 

Answer  a  -  Reply  in  words  to  a  question  7,8,9 

b  -  React  in  response  to  an  anticipated 
visual,  auditory  or  other  non-verbal 
stimulus  4 

Apply  a  -  Spread  a  substance  on  a  surface  15 

b  -  Use  General 

Appraise  a  -  Evaluate  (a)  1 

b  -  Evaluate  (b)  1 

Apprise  Inform  7,8 

Ascertain  Obtain  exact,  first-hand  knowledge  of 

a  condition  3 

Ask  Seek  informution  from  a  person  verbally  7,8,9 

Assemble  Perform  the  various  manual  operations 

necessary  to  place,  align,  fit,  or  secure 

together  two  or  more  components  to  complete 

a  larger,  more  complex  piece  of  equipment  11 

Assure  Ensure  General 

Attach  Connect  one  object  to  another;  in  general, 

it  will  be  a  smaller  object  onto  a  larger 

object  11 

Attack  Engage  (c)  10 
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Verb 


Definition 


Attempt 

Make  an  effort  to  accomplish  a  task  or 
goal,  but  with  the  realization  that  failure 
is  a  possibility 

General 

Begin 

Set  in  motion  some  action  or  process  by 
taking  the  first  step 

General 

Brief 

Inform 

7,8 

Calculate 

Compute 

1 

Calibrate 

Determine  and  correct  the  accuracy  of  a 
piece  of  equipment  by  special  measurement 
or  by  comparison  with  a  standard 

10 

Call 

a  -  Shout  or  announce 
b  -  Communicate  with  by  electromagnetic 

7 

means  (e.g.,  telephone,  radio) 

7 

Carry 

Move  a  load  while  supporting  it 

15 

Cease 

Stop  (a) 

General 

Change 

a  -  Alter 

General 

b  -  Remove/Replace 

11 

Check 

a  -  Held  back  or  restrain 
b  -  Verify  the  result  of  an  action,  the 

13 

existence  of  a  condition,  or  the 
accuracy  of  measurements 

3 

c  -  Mark  with  a  check 

15 

Check  out 

Inspect  for  satisfactory  condition, 
accuracy,  safety,  or  performance 

3 

Choose 

Select 

2 

Cipher 

Code 

1 

Classify^ 

Assign  objects,  symbols,  ideas,  etc.  to 
categories  based  on  their  characteristics 

5,6 

Clean 

Remove  dirt,  impurities,  or  extraneous 
matters 

10 

Cleanse 

Clean 

•  A 

(W 

4 

.Many  action  verbs  indicating  tbe  process  of  classifying  are  independent  of 
Che  object  classified.  Those  verbs  are  appropriate  both  the  categories  5  and 
6.  To  classify  a  particular  task  when  these  verbs  are  used,  you  nwst  also 
determi.ne  the  nature  of  tr.e  classified  object. 
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Verb 

Close 

Code 

Collate 

Collect 

Conmand 

Coonunlcate 

Compare 

Complete 

Compute 

Conduct 

Confinn 

Conform 

Connect 

uxtxnue 

Contrast 


Definition 


Category 


a  -  Move  something  so  as  to  block  passage 
through  an  opening  or  to  and  from  an 
enclosure  1 1 

b  -  Complete  an  electrical  circ  'it§  11 

Convert  a  message,  document,  etc-,  from 

ordinary  language  to  a  coded  system  of 

letters,  words,  numbers,  or  symbols  1 

a  -  Compare  5,6 

b  -  Gather  in  order  6 

a  -  Gather  together  (stress  on  physical  act 

of  gathering)  15 

b  -  Classify  (stress  on  identifying  objects 

to  be  gathered)  5,6 

Specify  verbally  a  course  of  action  to 

be  taken  by  others  7 


a  -  Broadcast  messages,  signals,  signs, 
writing,  images,  or  sounds  by  wire, 
radio,  visual,  or  other  electro¬ 
magnetic  means  (stress  on  operating 


the  cooiB'inications  equipment)  10 

b  -  Transmit  information  (stress  on  the 

message  transmitted)  7,8,9 

Examine  the  characteristics  of  two  or  more 

items  to  determine  their  similarities  and 

differences  5,6 

End  successfully  an  entire  task,  opera¬ 
tion,  or  mission,  or  part  thereof  General 

Determine  the  value  by  mathematical  means  1 

Manage  (a)  2 

Verify  3 

Adapt  3 

Couple,  fasten,  or  join  pieces  of  equipment  11 

a  -  Go  on  with  o  ocurse,  direction  or 

action  already  in  progress  General 

b  -  Resume  an  action  after  stopping  General 

Compare  to  ider.tify  differences  5,6 
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Verb 


Definition 


Control  a  -  Manipulate  repetitively  discrete-action 

switches,  linkages  and  controls  to  maintain 


equipment  in  an  in-tolerance  ccmdition  12 

b  -  Steer  13 

Convey  a  -  Transport  15 

b  -  Give  a  message  to  7,8 

Coordinate  Adjust  the  actions  of  various  people  or 

pieces  of  equipment  so  that  their  combined 

action  is  in  harmony  2 

Count  Add  up,  one  by  one,  the  total  nmber  of 

units  in  a  collection  1 

Deactivate  Remove  the  power  so  that  equipment  ceases 

operation  10 

Decide  a  -  Choose  a  course  of  action  2 

b  -  Make  a  judgment  2 

Decipher  Decode  1 

Decode  Convert  a  coded  message,  docunent,  etc. 

into  ordinary  language  1 

Decrease  Lessen  in  amount  General 

Delay  Stop  or  hinder  for  a  short  time  General 

Demand  Require  2 

Depress  Push  down,  especially  manually  15 

Detain  Delay  General 

Detect  Become  aware  of  the  existence,  prese-’ce,  or 

fact  of  a  particular  condition  4 

Determine  a  -  Ascertain  3 

b  -  Deciae  2 

Direct  a  -  Steer  13 

b  -  Connand  7 

Disable  Remove  from  a  state  of  readiness  sc  as  to 

prevent  actionS  1C 


Verb 


Definition 


Disassemble  Perform  the  various  manual  operations 

necessary  to  take  apart  a  piece  of 
equipment  to  the  next  lower  level  of  sub- 
assemblies  or  to  the  level  of  component 
parts  11 

Discard  Throw  away  or  get  rid  of  equipment  or 

components  which  are  no  longer  functional 

or  useful  2 

Discharge  a  '  Unload  or  empty  15 

b  “  Fire  10 

G  -  Perform  an  obligation  General 

d  -  Remove  stored  energy  from  a  battery 

or  capacitor  '  10 

Disconnect  Separate  or  undo  the  corjiection  between 

pieces  of  equipment  11 

Discontinue  Stop  (a)  General 

Discover  Ascertain  3 

Disengage  a  -  Disconnect  or  loosen  a  fastening  so 

that  it  no  longer  restricts  movement  11 

b  -  Disconnect  or  loosen  a  power  transfer 
device  so  that  power  is  no  longer 
transferred  10 

Disjoin  Disconnect  1 1 

Divide  a  -  Separate  11 

b  -  Classify  5,6 

c  -  Perform  the  mathematical  operation 
of  finding  how  many  times  one  nonber 
contains  another  number  1 

Draft  Draw  the  preliminary  sketch,  versioji  or 

plan  of  an  object  1^ 

Drag  Pull  (a)  15 

Staploy  Use  General 

Sapty  Pour  out  or  remove  the  contents  of  a 

container  15 

S^ble  Bring  to  a  state  of  readlnessS  10 

Ei'code  CoJe  1 
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Verb 

Definition 

Category 

Endeavor 

Attempt 

General 

Engage 

a  -  Connect  or  lock  a  fastening  so  that 

movement  is  restricted 

b  Connect  or  fasten  a  power  transfer  device 

11 

so  that  power  is  transferred 

10 

c  -  Attack  designated  contact 

10 

Ensure 

Make  certain;  guarantee  the  existence 

of  a  condition 

General 

Enter 

Inputs 

8 

Enunerate 

‘a  -  Count 

1 

b  -  List 

1 

Establish 

Set  up  0”  institute  initially 

General 

Estimate 

Evaluate  (a) 

1 

Evaluate 

a  -  Determine  the  numerical  amount  or 

monetary  value  of  equipmant 
b  -  Judge  the  condition  or  worth  in  non¬ 
monetary  terms  of  a  piece  of  equipment 

1 

or  procedure 

1 

Examine 

a  -  Interrogate  (a) 

7 

b  -  Inspect 

4 

Execute 

Carry  out,  especially  orders  or  plans 

General 

Extend 

Reach  out  cr  draw  out  to  or  from  a 

given  point 

11 

Fasten 

a  -  Attach 

11 

b  -  Lock  (a) 

10 

Fill 

Pour  or  put  into  a  container,  especially 
an  amount  which  occupies  the  entire 

volume 

15 

Finish 

a  -  Complete 

General 

b  -  Give  a  desired  effect  to  a  surface 

14 

Fire 

Cause  a  weapon  to  emit  a  projectile 

10 

Ely 

Opt^r'ciCc  UidiUiwk  Oi’  CP 

spacecraft  through  the  air  or  space, 

especially  after  it  has  left  the  ground 

13 

Follow 

lo  after,  either  in  order  or  time 

General 

C-1-7 


Verb 

Definition 

Category 

Furnish 

Provide 

General 

Guide 

Steer 

13 

Halt 

Stop  (a) 

General 

Handle 

a  -  Control  (a) 

12 

b  -  Manage  (a) 

2 

c  -  Steer 

13 

Identify 

Recognize  or  determine  the  exact  nature 
of  something 

5,6 

Illuminate 

Give  light  to  an  area  or  display  surface 

10 

Increase 

Add  to  or  augment 

General 

Inform 

Give  knowledge  of  something  to  one  or 
more  persons 

Y.8 

Initiate 

Bring  into  practice  or  action  by  first 
doing  or  using 

General 

Input 

Insert  conmands  and/or  data  into  a  machine 
by  electromechanical  means  (e.g.,  keyboard)§ 

8 

Insert 

Put  or  fit  something  into  something  else 

11 

Inspect 

Look  at  carefully,  especially  in  order 
to  detect  flaws  or  errors 

U 

Install 

Attach  or  mount  in  position  for  use 

11 

Instruct 

Cormunicate  knowledge  in  a  learning  setting 

7 

» 

Insure 

Ensure 

General 

Interrelate 

a  -  Ask  questions  of  in  a  systematic 

manner 

7 

b  -  Signal  a  device  or  cen^juter  so  as  to 

receive  information  regarding  the 
status  or  condition  of  its  componentsS 

8 

Introduce 

a  -  Insert 

11 

b  -  Initiate 

General 

Isclate 

a  -  Find  or  iderjtify,  especially  the  cause 

of  an  equipment  malfunctions 

3 

b  -  Set  apart  from  other  objects  or  people 

n 

Iterate 

.  Repeat,  especially  a  process 

General 

C-U8 


Verb 


Definition 


Judge 


Junk 

Land 


Launch 


Lay 

Light 


a  -  Evaluate  (a) 
b  -  Evaluate  (b) 
c  -  Decide 

Discard 

Set  a  manned  or  unmanned  aircraft  down  on 
a  surface  (e.g.,  land,  water)  and  bring  It 
to  a  stop  (excludes  taxiing) 

a  -  Begin  the  flight  of  a  missile  or  rocket 
b  ■-  Send  forth  with  some  added  force  (e.g., 
launch  an  aircraft  by  catapult) 

Adjust  a  gun  to  proper  direction  and  elevation 

Illtminate 


Line 

List 

Listen  for 
Load 


Locate 

Lock 


Log 

Loosen 

Lower 


Maintain 


Align 

Make  a  list  or  category  of  people,  objects, 
ideas ,  etc 

Be  aleit  to  catch  an  unexpected  sound 

a  -  Inputt> 
b  -  Fill 

c  -  Put  annunition  in  a  weapon 
d  -  Place  an  electrical  load  on  a  battery 
or  generator^  * 

a  -  Isolate  (a) 

b  -  Find  a  location  as  on  a  map 

a  -  Fasten  shut  by  means  of  S  lock 
b  -  Jam  or  force  together  so  as  to  be 
immovable  (e.g.,  lock  brakes) 
c  -  Put  or  fasten  in  a  fixed  position 

Record  (a) 

Lessen  the  force  applied  by  a  binding  or 
fastening,  especially  so  as  to  permit 
movement 

Move  an  object  in  a  downward  direction, 
attitude,  or  ngle 

a  -  Keep  at  th*  ^ame  level  or  position 
b  Keep  in  operating  condition  or  good 
repair 


(^tegory 

1 

1 

2 

2 

13 

10 

10 

11 

10 

11 

1 

4 

b 

15 

11 

n 

3 

5 

10 

10 

11 

S 

15 

11 

13 

General 


C-l-9 


Verb 

Maiiage 

Mate 

Mend 

Monitor 

Multiply 

Note 

Notify 

Numerate 

Observe 

Obtain 

Open 

Operate 

Order 

Overhaul 


Definition 


Category 


a  -  Have  control  over  2 

b  -  Control  (a)  12 

c  -  Steer  13 

Connect  1 1 

Repair  10 

a  -  Watch  or  check  on  the  performance  or 

condition  of  equipment  M 

b  “  Watch  or  listen  to  the  output  of  de¬ 
tection  devices  (e.g.,  radar  screen)  4 

c  -  Watch  or  listen  to  the  transmission  of 

information  7,b,9 


Perfonn  the  mathematical  operation  of  add¬ 
ing  a  number  to  itself  a  specifi&i  nimber 
of  times 


a  -  Record  (a)  ,  b 

b  -  Observe  (b;  General 

c  -  Obsen/e  (c)  4 

Inform  7,b 

Count  1 

a  -  Adhere  to,  follow,  or  abide  by  a  set 

of  rules  1 

b  -  Pay  special  attention  to  General 

c  -  Look  at  4 


Get  possession  of  or  procure,  especially 
by  some  effort 

a  -  Move  something  so  as  to  permit  passage 
through  an  opening  or  access  to  an 
enclosure 

b  -  Break  an  electrical  circuits 

Put  or  keep  a  piece  of  equipment  in  pur¬ 
poseful  action 


General 


n 

n 


General 


a  -  Arrange  in  sequence  b 

b  ~  Cccstand  7 

c  -  Requisition  b 

Chuck  thoroughly  for  needed  repairs  and 

to  make  those  repairs  and  adjustmwts  so 

as  to  restore  equipment  to  good  vrorking 

order  10 


C-l-lO 


Verb 


Definition 


Category 


Package 


Wrap  or  box,  as  for  transporting  or 

carrying  10 


Park 

Pass 

Perform 

Place 

Play 

Plug 


Position 

Prepare 

Present 


Press 

Prole 

Prov j  de 
Pull 


Push 

Ouerv 


Maneuver  a  v^icle  into  a  space  where  it 

can  be  left  temporarily  13 

Cause  or  allow  an  object  to  go  through  or 

around  another  (e.g.,  pass  the  rope  through 

the  eyelet,  pass  a  vehicle  on  the  road)  13 

Act  on  or  do  so  as  to  bring  to  completion  Generad 

Put  an  object  in  a  particular  place,  con¬ 
dition,  or  relation  to  other  objects  11 

Cause  a  video  or  audio  recording  to  give 

out  linages  and/or  30un>l3  through  the 

operation  of  a  playback  device  10 

a  -  Stop  up  or  fill  a  hole  or  gap  by  li>* 

sorting  a  plug  11 

b  -  To  connect  an  electrical  device  with 
a  power  source  by  inserting  the  power 
oord  in  a  socket  or  jack  (usually 
used  with  1 1 

Place  11 

Make  ready,  usually  for  a  specific  purpose  General 

Exhibit  or  display  an  image  or  message  on 
a  screen  10 

Depress  15 

a  -  Interrogate  (a)  7 

b  -  Explore  inanual-ly  with  a  probe  4 

Hake  available  mater'ial  or  services  General 


a  -  Exert  force  cn  an  object  so  as  to 
cause  the  object  to  move  toward  or  in 
the  same  direction  as  the  soui'ce  of 
the  I'orce  15 

b  -  Extract  15 

Exert  force  against  so  as  to  move  an 

object  away  from  the  source  of  the  force  *  15 

Ask  7.b,9 


c-i-ii 


Verb 


Definition 


Question  Interrogate  (a)  7 

Raise  Move  an  object  in  an  upward  direction, 

attitude,  or  angle  11 


Reach  a  -  Extend  to  or  touch  by  thrusting  out  1 1 

b  -  Penetrate  to  11 

Read  a  -  Get  the  meaning  of  something  written 

by  using  the  eyes  6 

b  -  Observe  and  record  values  indicated 

by  visual  displays  or  gauges  6 

Receive  Get  visual  or  auditory  messages  or  signals 

by  electromagnetic  means  (e.g.,  radio, 

telephone)  10 

Record  a  -  Put  in  writing  for  future  use  b 

b  -  Register  sound  or  visual  images  in 
some  permanent  form,  such  as  phono¬ 
graph  disc,  magnetic  tape,  etc.,  for 
reproduction  on  a  playback  device  10 

Recognize  Perceive  to  be  something  previously  known  5,6 

Regulate  a  -  Control  (a)  12 

b  -  Steer  13 

Reiterate  Repeat,  especial..y  a  spoken  message  or 

order  for  emphasis  7 

Release  a  -  Let  go  or  let  loose  from  the  manual 

application  of  pressure  15 

b  -  Set  free  from  a  restrictive  force 

(e.g.,  release  the  brake)  10 

Remove  a  -  Lift,  push,  transfer,  or  carry  some¬ 

thing  away  from  its  current  location 
to  another  11 

b  -  Take  an  object  off  of  another  11 


Repair  Replace  or  restore  damaged,  worn  out,  or 

malfunctioning  components  so  that  the 

equipment  is  serviceable,  usable,  or  in 

operating  condition.  10 

Repeat  a  -  Say  again  7 

b  -  Do  or  make  a  tasK,  test,  or  operation 
an  ado  itional  time;  do  over  again 


General 


Verb 

Replace 

Reply 

Report 

Request 

Require 

Requisition 

Respond 

Restore 

Resume 

Retract 

Return 

Reveal 

Review 

Revise 

Rotate 

Scrap 
Sc-  utinize 


Definition  Category 


a  -  Put  something  back  in  the  proper  place 

or  position  1 1 

b  -  Provide  a  substitute  or  equivalent  for 

equipment  or  components  of  equipment  11 

Respond  7,B,9 

a  -  Give  an  account  of  something  seen  or 

done,  often  at  regular  intervals  7,d 

b  -  Make  known  the  presence,  approach,  or 

occurrence  of  something  or  someone  7,9 

Ask  for  something  or  some  action  1,^,9 

Ask  or  insist  upon  by  right  of  authority  2 

Submit  a  written  order  or  request  for 

something  b 

Say  in  arjswer  7 

Repair  10 

Begin  again  or  go  on  with  again  after 

interruption  General 

Draw  back  or  draw  in  some  item  of  equipment  11 

Replace  (a)  11 

Present  10 

Examine  work  performed  or  documents  pro¬ 
duced  to  determine  adequacy,  oorrectness, 
preciseness,  etc.  2 

Read  over  carefully  and  correct,  improve, 

or  update  a  docvmait,  procedure,  or 

regulation  3 

a  -  Turn  ai'ound  or  cause  to  turn  around 
a  center  point  or  axis  in  either 
direction  15 

b  -  Take  or  cause  to  take  turns  in  regular 

succession  (e.g.,  rotate  the  tires)  11 

Discard  2 

Inspect  *4 
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Verb 

Definition 

Category 

SesI 

a  -  Close  so  as  to  prevent  non-destructive 

opening  of  a  container  or  enclosure 

10 

b  -  Close  con^letely  so  as  to  make  airtight 

or  watertight 

10 

c  -  Apply  a  non- permeable  coating  to  a 

porous  surface,  as  before  painting 

10 

Secure 

a  -  Make  firm,  fast  or  tight 

11 

b  -  Put  under  restraint;  tie  up 

11 

Seize 

Take  hold  of  forcibly  with  the  hand; 
clutch 

15 

Select 

Pick  out  froai  among  alternatives 

2 

Send 

Transmit 

10 

Separate 

Place  the  parts  of  an  object  in  physically 
separate  locations 

11 

Service 

Make  or  keep  fit  for  service  as  by  in¬ 
specting,  adjusting,  repairing,  re¬ 
fueling,  etc. 

10 

Set 

Adjust  a  measuring  device  to  a  desired 
position  or  to  be  in  conformity  with  a 
stand  a'xJ 

11 

Set  up 

Arrange  a  piece  of  equipment  and  necessary 
servicing  tools  preparatory  to  checking 
out  or  servicing  that  piece  of  equipments 

11 

Sew 

Unite  or  fasten  by  stiches  made  with 
flexible  thread  or  filament 

14 

Sharpen 

Make  sharp  or  sharper  a  cutting  edge  or 
piercing  point 

14 

Shove 

Push 

15 

Shut 

a  -  Close  (aj 

b  -  Fold  up  or  bring  together  the  parts 

11 

of  a  device 

11 

Signal 

Connunicate  by  sight  (e.g.,  flags,  flashing 
lights,  hand  signs)  or  sound  (e.g.,  Morse 
cede,  tones)  oliier  chan  writteri  or  spoken 

language 

9 

Splice 

Unite  by  interviewing  stra.nds  or  lapping 
twi  ends 

14 

>1-11 

Verb 

Definition 

Category 

Start 

a  -  Begin 

General 

b  -  Set  in  motion,  action,  or  operation 

10 

Stay 

a  -  Delay 

General 

b  -  Stop  (a) 

General 

Steer 

Manipulate  the  continuous-action  controls  of 
a  vehicle  (e.g.,  steering  wheel)  so  as  to 

determine  its  course  or  movement 

15 

Stop 

a  -  Interrupt  or  end  the  motion  or  opera¬ 

tion  of  equipment  or  the  progress  of 
a  proceas 

General 

b  -  Plug  (a) 

11 

Store 

a  -  Put  aside  for  use  when  needed 

11 

b  -  Put  in  a  warehouse  for  safekeeping 
c  -  Placing  or  keeping  information  in  a 

11 

computer  memory 

10 

Stretch 

Extend 

11 

Strive 

Attempt 

General 

Succeed 

Follow 

General 

Supply 

Provide 

General 

Survey 

View  comprehensively 

4 

Switch 

Change  (b) 

11 

Subtract 

Perform  the  mathematical  operation  of 
deducting  or  removing  one  nunber  from 
another 

1 

Take 

a  -  Get  possession  of  by  force;  grasp 
b  -  Obtain  possession  of  or  assume  control 

15 

of  equipment,  not  by  force  or  skill 
(e.g.,  take  control  of  an  aircraft) 

2 

Take  off 

Cause  an  aircraft  to  leave  the  surface 
(e.g.,  g.-^iind,  water)  in  flight 

13 

Taxi 

Cause  an  aircraft  to  move  s)owly  along 
the  surface  (e.g  ,  ground,  water)  under 
its  own  power  as  before  taking  off  or 
after  Ic-inding 

13 

Teach 

Instruct 

7 
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Verb 

Definition 

Category 

Test 

a  -  Operate  equipment  on  a  temporary  basis 
to  determine  if  it  is  functioning 

properly 

b  -  Operate  equipment  to  determine  the 

10 

limits  of  its  perforiuance 

10 

Throw 

a  -  Cause  to  fly  through  the  air  by  re¬ 
leasing  from  the  hand  while  the  arm 

is  in  rapid  motion;  hurl 
b  -  Move  a  lever,  clutch,  or  switch  or 
connect,  disconnect,  or  engage  a 

15 

power  source  by  such  movement 

11 

Tighten 

Increase  the  force  applied  by  a  binding 
or  fastening,  especially  so  as  to  restrict 

movement 

15 

Track 

a  -  Keep  a  gun  properly  aimed,  or  to  point 
continuous Iv  a  target  locating  instru¬ 

ment  at  a  moving  target.# 
b  -  Lock  onto  a  point  of  radiation  and  obtain 

13 

gijidance  therefrom.# 

13 

Transfer 

a  -  Convey,  carry,  or  send  an  object  from 

one  place  to  another 
b  -  Give  to  another  person,  especially 

15 

authority  or  control 

2 

Transmit 

Send  out  a  message  by  means  of  electro¬ 

magnetic  radiation 

10 

Transport 

Carry  from  one  place  to  another,  especially 

over  long  distances 

15 

Troubleshoot 

Locate  and  eliminate  the  source  of  trouble 

in  any  flow  of  work  or  operating  system 

3 

Try 

Attempt 

General 

Tug 

Puli  at  with  great  force 

15 

Tune 

Adjust  equipment  to  the  proper  or  desi.’'ed 

performance  level 

10 

Tjm 

F.otate  (a) 

15 

Type 

Print  or  display  alphancmeric  characters  or 

s^.tr.bols  by  pr’essir.g  xeys  or.  a  keyboard 

8 

■Jpuate 

Make  .'or form  to  the  most  recent  facts, 

m-^'coclr,  liea.s,  etc. 

3 

Category 


Verb 


Definition 


Use 

Utilize 

Vary 

Verify 

Wait 

Watch 

Weld 

Wield 


Put  or  bring  a  plan  or  piece  of  equipment 
into  action  or  service  so  as  to  accomplish 
an  end 

Use 

Change  (a) 

Substantiate  the  correctness  of  something 
by  demonstration,  evidence,  or  testimony 

Stay  or  remain  in  a  state  of  readiness  in 
anticipation  of  something;  await 

Observe  (c)  ^ 

Unite  metallic  parts  by  heating  and  allowing 
the  metals  to  flow  together 

Handle  (a),  especially  with  skill 


General 

General 

General 

3 

General 

4 

14 

12 
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ANNEX  C 


APPENDIX  2 

CATEGORX/SYNONYM  LIST 


1.  Selecting  and  applying  rules 

Tasks  in  this  category  have  as  their  central  behavior  deciding  which  rule 
is  appropriate  to  the  goal  and/or  applying  the  appropriate  rule  properly.  Rules 
specify  how  quantities,  objects,  or  situations  are  transformed  into  other  quan¬ 
tities,  objects,  or  situations.  The  rule  may  be  general  (e.g.,  rule  for  multi¬ 
plying  two  nunbers)  or  it  may  be  a  list  of  possibilities,  that  is,  a  series  of 
"If  ...  then"  statsnents  A  rule  (as  opposed  to  a  procedure)  is  never  limited 
to  a  single  possibility.  The  correct  choice  and  application  of  the  rule  will 
always  lead  to  accomplishment  of  the  goal. 


Verb 

Synonyms 

Accumulate  (b) 

Add 

Add 

Accimulate  (b) 

Appraise  (a) 

Estimate;  Evaluate  (a);  Judge  (a) 
Evaluate  (b);  Judge  (b) 

Appraise  (b) 

Calculate 

Compute 

Cipher 

Code;  Encode 

Code 

Cipher;  Encode 

Compute 

Calculate 

Count 

Enumerate  (a);  Numerate 

Decipher 

Decode 

Decode 

Divide  (c) 

Decipiier 

Encode 

Cipher;  Code 

Enumerate  (a) 

Count;  Numerate 

Envmerate  (b) 

List 

Estimate 

Appraise  (a);  Evaluate  (a);  Judge 

Evaluate  (a) 

Appraise  (a);  Estiinate;  Judge  (a) 

Evaluate  (b) 

Appraise  (b);  Judge  (b) 

Judge  (a) 

Appraise  (a);  Estimate;  Evaluate 
Appi*aise  (b);  Evaluate  (b) 

Judge  (b) 

List 

Multiply 

Enunerate  (b) 

Numerate 

Observe  (a) 

Subtract 

Count;  Enunerate  (a) 
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2. 


Making  decisions 


Tasks  in  this  category  have  as  their  central  behavior  choosing  a  course  of 
action  when  the  best  available  alternative  may  not  be  successful.  The  relative 
value  of  success  and  cost  of  failure  for  each  alternative  must  be  considered. 
Often  the  range  of  possible  alternatives  is  wide  and  unspecified  and  the  choice 
must  be  made  rapidly,  without  exhaustive  consideration  of  alternatives. 


Verb 

Synonyms 

Choose 

Decide  (a);  Determine  (b);  Select 

Conduct 

Handle  (b);  Manage  (a) 

Coordinate 

Decide  (a) 

Choose;  Determine  (b);  Select 

Decide  (b) 

Judge  (c) 

Demarxi 

Require 

Determine  (b) 

Choose;  Decide  (a);  Select 

Discard 

Junk;  Scrap 

Handle  (b) 

Conduct;  Manage  (a) 

Judge  (c) 

Decide  (b) 

Junk 

Discard;  Scrap 

Manage  (a) 

Conduct;  Handle  (b) 

Require 

Demand 

Review 

Scrap 

Discard;  Junk 

Select 

Choose;  Decide  (a);  Determine  (b) 

Take  (b) 

Transfer  (b) 

3 .  Solving  oroblans 


Tasks  in  this  cateigory  have  as  their  central  behaviors  identifying  the 
source  of  the  problem  and  choosing  the  actions  necessary  to  correct  it.  If 
the  actual  correction  of  the  problem  is  likely  to  be  a  major  part  of  the  task, 
then  "following  procedures"  may  a  more  appropriate  category.  Identifying 
the  problem  source  usually  Involves  a  systematic,  exhaustive  consideration  of 
the  possibilities  with  little  prei^sure  for  quick  Judgments. 


Verb 

Synonytas 

Adapt 

Adjust  (b);  Conform 

Adjust  (b) 

Adapt;  Conform 

Ascertain 

Determine  (a);  Discover 

Check  (b) 

Check  out 

Confirm;  Verify 

Check  (b);  Verify 

Adapt;  Adjust  (b) 

Conform 

Determine  (a) 

Ascertain,  Discover 

Discover 

Ascertain;  Determine  (a) 

Isolate  (a) 

Locate  (a) 

Locate  (a) 

Isolate  (a) 

Revise 

Update 

Update 

Revise 

Verify 

Check  (b);  Confirm 

4 .  Monitoring 


Tasks  in  this  category  have  as  their  central  behavior  careful  watching  or 
listening  for  an  important  signal  against  a  background  of  other,  irrelevant 
signals.  The  task  may  involve  prolonged  attending  to  the  likely  source  of  the 
sigTial  or  it  may  involve  short  but  careflil  examination.  Often  the  frequoicy 
of  signal  occurrence  and/or  the  signal  to  noise  ratio  is  very  low. 


Verb 

Synonyms 

Acknowledge  (b) 

Answer  (b) 

Answer  (b) 

Acknowledge  (b) 

Acquire 

Detect 

Examine  (b) 

Inspect;  Scrutinize 

Inspect 

Examine  (b);  Scrutinize 

Listen  for 

Monitor  (a) 

^tonito^  (b) 

Note  (c) 

Observe  (c);  Watch 

Observe  (c) 

Note  (c);  Watch 

Probe  (b) 

Scrutinize 

Examine  (b);  Inspect 

Watch 

Note  (c);  Observe  (c) 
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5.  Classifying  perceptual,  non-graphic  signals^ 

Tasks  in  this  category  have  as  their  central  behavior  recognizing  perceptual 
patterns  as  belonging  to  a  particular  class  or  category.  The  classes  may  be 
general  (friend  or  foe)  or  specific  (F’-4).  While  the  signal  to  noise  ratio  is 
usually  high,  the  time  available  for  classifying  may  be  short. 


Verb 

Synonyms 

Classify 

Divide 

Collate  (a) 

Collect  (b) 

Compare 

Compare 

Contrast 

Collate  (a) 

Divide 

Classify 

Identify 

Locate  (b) 

Recognize 

Recogni ze 

Identify 

Vany  action  verts  Lndicating  the  process  of  classifying  are  independent  of 
tr.fe  object  classified.  These  verbs  are  appropriate  both  for  categories  5  and 
6.  To  classify  a  particular  task  when  these  •/e.-'ts  are  used,  you  must  also 
detemir.c  the  rature  of  the  classified  object. 
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b.  Identifying  graphic  symbols 

Tasks  in  this  category  have  as  their  central  behavior  recognizing  and  iden¬ 
tifying  previously  learned  graphic  symbols.  These  symbols  usu2dly  mean  little 
to  untrained  people.  Examples  of  such  symbols  include  electronic  symbols  on  a 
schematic  drawing,  weather  map  symbols,  and  tactical  status  symbols. 


Verb 

Synonyms 

Classify 

Divide 

Collate  (a) 

Compare 

Collate  (b) 

Order  (a) 

Collect  (b) 

Corapar’e 

Collate  (a) 

Contrast 

♦ 

Divide 

Classify 

Identify 

Order  (a) 

Collate  (b) 

Read  (a) 

Read  (b) 

Recogni2e 

Identify 

? 

See  note  1 . 
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7.  Coranunicating  by  voice-' 

Tasks  in  this  category  have  as  their  centr  al  behavior  the  giving  and/or  re¬ 
ceiving  of  infonnation  by  means  of  spoketi  language.  The  task  may  involve  the 
use  of  a  specialized  language  or  vocabulary.  Standard  patterns  for  both  the 
message  and  the  response  are  often  specified. 


Verb 


Synon\'ma 


Acknowledge  (a) 

Acquaint 

Advise 

Alert 

Answer  (a) 

Apprise 

Ask 

Brief 

rail  (a) 

Call  (b) 

Command 

Communicate  (b) 
Convey  (b) 
Direct  (b) 
Examine  va) 
Inform 
Instruct 
Interrogate  (a) 
Monitor  (c) 
Notify 
Order  (b) 

Probe  (a) 

Query 
Question 
F.eiterate 
Repeat  (a) 

Reply 
Report  (a) 
Report  '.b) 
Request 
Respo^id 
Teach 


Answer  (a) 

Advise;  Apprise;  Brief;  Inform;  Notify 
Acquaint;  Apprise;  Brief;  Inform:  Notify 

Acknowledge 

Acquaint;  Advise;  Brief;  Inform;  Notify 
Query 

Acquaint;  Advise;  Apprise;  Inform;  Notify 

Coanunicate  (b) 

Direct  (b);  Order  (b) 

Call  (b) 

Conmand;  Order  Cb) 

Interrogate  (a);  Probe  (a);  Question 
Acquaint;  Advise;  Apprise;  Brief;  Notify 
Teach 

Examine  (a);  Probe  (a);  Q^’.t'stion 

Acquaint;  Advise;  Apprise;  Brief;  Inform 
Coanand;  Direct  lb) 

Exarai.ne  (a);  Interrogate  la);  Question 
Ask 

Examine  (a);  Interrogate  (a);  Prcbe  (a) 
Repeat  (a) 

Reiterate 

Respond 


Reply 

Instriict 


I  _ 

!  ^Many  action  verbs  indicate  the  process  of  information  transfer  without 

?  reference  to  the  means  of  transfer.  These  verbs  are  appropriate  both  to 

I  categories  7  and  B.  These  verbs  may  also  be  appropriate  to  category  9 

I  although,  signaling  is  no*-  usually  appropriate  to  the  communication  of  large 

I  quantities  of  information  or  fi.ne  detail.  To  classify  a  particular  task 

I  when  t.ncse  verbs  are  une-i,  you  must  also  determine  the  conniunication  process. 


8. 


Goramunicating  by  writing  or  typing 


Tasks  in  this  category  have  as  their  central  behavior  the  giving  of  infor¬ 
mation  by  means  of  written  or  typed  language.  The  task  may  involve  use  of  a 
specialized  language  or  vocabulary  in  standard  formats.  Tasks  involving  the 
receipt  of  written  information  fall  in  category  6. 


Vero 


Synonyms 


Acknowledge  (a) 
Acquaint 
Advi  se 
Alert 

An-^wer  (a) 
Apprise 
Ask 
Brief 

Communicate  (b) 
Convey  (b) 

Enter 

Inform 

Input 

Interrogate  (bj 
Load  (a) 

Log 

Monitor  (c) 

Note  (a) 

Notify 
Order  (c) 

Query 
Record  (a) 

Reply 

Report  (a) 

Re^iuest 

Requisition 

Respond 

Typo 


Ap.swer  (a) 

Advise;  Apprise;  3rief;  Inform;  Notify 
Acquaint;  Apprise;  Brief;  Inform;  Notify 

Acknowledge 

Acquaint;  Advise;  Brief;  Inform;  Notify 
Query 

Acquaint;  Advise;  Aporise;  Inform;  Notify 


Input;  Load  (a) 

Acquaint;  Advise;  Apprise;  Brief;  Notify 
Enter;  Load  (a) 

Enter;  Input 
Note  (a);  Record  (a) 

Log;  Record  (a) 

Acquaint;  Advise;  Apprise;  Brief;  Inform 

Requisition 

Ask 

Log;  Note  (a) 

Respond 


Order 

Reply 


9.  Coowunicating  non-verbally  (signaling) 

Tasks  in  this  category  have  as  their  central  behavior  the  giving  and  re¬ 
ceiving  of  information  through  means  other  than  language,  i.e.,  signals.  The 
signal  vocabulary  may  be  narrow  (e.g.,  go/ no  go;  OK/ trouble)  or  wide  (e.g., 
semajsnore  signalsj  or  the  signals  may  have  a  direct  correspondence  to  letters 
(e.g.,  Horse  code) . 


Verb 

Acknowledge  (a) 
Alert 
Answer  (a) 

Ask 

Coranuriicate  (b) 

Monitor  (c) 

Query 

Reply 

Report  (b) 

Respond 

Signal 


Answer 


Acknowledge 

Query 


Ask 

Respond 

Reply 
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10.  Following  procedures 

Tasks  in  this  category  have  as  their  central  behavior  following  the  steps 
of  a  procedure.  A  procedure  is  a  specific  set  of  actions  designed  to  produce  a 
specific  result.  The  steps  may  be  cognitive,  physical,  or  both.  Procedi^es  may 
be  designed  to  govern  operation  or  repair  of  equijxnent.  Procedures  involving 
positioning  movanents  or  discrete  regulatory  movements  are  more  appropriate  for 
tasks  in  categories  11  and  12,  respectively. 


Verb 

Activate 

Attack 

Calibrate 

Clean 

Cleanse 

Communicate  (a) 
Deactivate 
Disable 
Discharge  (b) 
Discharge  (d) 
Disengage  (b) 
Enable 
Engage  (b) 
Engage  (c) 
Fasten  (b) 

Fire. 

Illuminate 
L,c.unch  (a) 

La; inch  (b) 

Li/ht 
Look  (a) 

Lock  (b) 

Mend 

Ovt  .-’haul 

Package 

Flav 

?re;.-.int 

.lecPLve 

Record 

i'ei?aje 

Repair 

Restore 

Reveal 

.Rotate  (b) 

Seal  Ca) 

Seal  (b) 
i'eai  'o) 

ISend 
S -TV  ice 
ftai't  lb) 

Store  \c) 

’a) 

Test  lb) 
Tra-osmit 
Tu.ne 


Synonyms 

Start  (b) 
Erii^age  (c) 

Cleanse 

Clean 

Send;  Transmit 


Fire 


Attack 
Lock  (a) 
Discharge  (b) 
Light 


Iliuninate 
r  .tsten  (b) 

Repair;  Restore 


Reveal 


Kend;  Restore 
Mend;  Repair 
Present 


Communicate  (a); 
■Ictivate 


Cormunicate  \a); 


Transmit 


Sena 
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11.  Positioning  movements 


Tasks  in  this  category  have  as  their  central  behavior  positioning  movements, 
either  singular  or  in  sequences.  Procedures  involving  positioning  movements  are 
also  in  this  category.  Tasks  involving  cognitive  procedures  are  more  appropriate 
to  category  10.  Tasks  involving  repeated  positioning  movements  vMch  serve  to 
regulate  some  state  of  the  equipment  should  he  classified  in  category  12. 


Verb 

Synonyms 

Adjust  (a) 

Align 

Line 

Assemble 

Attach 

Connect;  Fasten  (a);  Mate 
Replace  (b);  Switch 

Slut  (a) 

Change  (b) 

Close  (a) 

Close  (b) 

Connect 

Attach;  Fast(in  (a);  Mate 

Disassemble 

Disconnect 

Disjoin 

Disengage  (a) 

Disjoin 

Disconnect 

Divide 

Separate 

Engage  (a) 

Extend 

Reach  (a);  Stretch 

Fasten  (a) 

Attach;  Connect;  Mate 

Insert 

Introduce  (a) 

Install 

Introduce  (a) 

Insert 

Isolate  (b) 

Lay 

Line 

Align 

Load  (c) 

Load  (d) 

Lock  (c) 

Lower 

Mate 

Attach;  Connect;  Fasten  (a) 

Cpen  U) 

Open  (b) 

Place 

Position 

Plug  (a) 

Stop  (b) 

Plug  (b) 

Position 

Place 

Raise 

Reach  (a) 

Extend;  Stretch 

Reach  (b) 

Remove  (a) 

Remove  (b) 

Replace  (a) 

Return 

Replace  (b) 

Change  (b);  Switch 

Retract 

Return 

Replace  (a) 

Secure  (a) 

Secure  (b) 

C-2-11 

Verb 

Separate 

Set 

Set  up 
Shut  (a) 
Shut  (b) 
Stop  (b) 
Store  (a) 
Store  (b) 
Stretch 
Switch 
Throw  (b) 


Synonyms 

Divide 

Close  (a) 

Plu^  \>a) 

Extend;  Reach  (a) 
Change  (b);  Replace  lb) 
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12.  Discrete  regulatory  movemaits 


Tasks  in  this  category  have  as  their  central  behavior  regulatory  movements 
irtiich  are  discrete  in  nature.  That  is,  discrete  movem«its  rather  than  contin¬ 
uously  variable  movements  are  used  to  control  the  position  or  state  of  the 
equipmait.  While  the  controls  are  discrete,  the  state  of  the  system  must  be 
continuously  monitored  and  corrected. 


Verb 


Synonyms 


Acquire 
Cojtrol  (a) 
Handle  (a) 
Mani;'.ge  (b) 
Regulate  (a) 
Wield 


Handle  (a);  Manage  (b);  Regulate  (a) 
Control  (a);  Manage  (b);  Regulate  (a) 
Control  (a);  Handle  (a);  Regulate  (a) 
Control  (a);  Handle  (a):  Manage  (b) 
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13.  Continuous  regulatory  movements 

Tasks  in  this  category  have  as  their  central  behavior  dynamic  perceptual 
motor  coordination  to  keep  the  position  or  state  of  the  equipmait  at  a  desired 
value.  Con^jensating  movements  are  continuously  made  in  response  to  feedback 
from  the  system. 


Verb 

Check  (a) 
Control  (b) 

Direct  (a) 

Fly 

Guide 

Handle  (c) 

Land 

Maintain  (a) 
Manage  (c) 

Park 

Pass 

Regulate  (b) 
Steer 


Direct  (a);  Guide;  Handle  (c);  Manage  (c); 
Regulate  (b);  Steer;  Track 
Control  (b);  Guide;  Handle  (c);  Manage  (c); 
Regulate  (b);  Steer 

Control  (b);  Direct  (a);  Handle  (c); 

Manage  (c);  Regulate  (b);  Steer 

Control  (b);  Direct  (a);  Guide;  Manage  (c); 

Regulate  (b);  Steer 


Control  (b);  Direct  (a);  Guide;  Handle  (c); 
Regulate  (b);  Steer 


Control  (b);  Direct  (a);  Guide;  Handle  (c) ; 
Manage  (c);  Steer 

Control  (b);  Direct  (a);  Guide;  Handle  (c); 
Manage  (c);  Regulate  (b) 


Take  off 

Taxi 

Track 


Guide;  Control  (b);  Steer 


14.  Performing  motor  skills 


Tasks  in  this  category  have  as  their  central  behavior  applying  previously 
learned  motor  skills.  These  skills  must  have  been  learned  to  the  point  that 
procedural  guidelines  are  unnecessary. 


Draft 
Finish  (b) 
Sew 

Sharpen 

Splice 


Weld 


15.  Gross  motor  ikjvements 


Tasks  in  thifi  category  have  as  their  central  behavior  gross  motor  movements 
The  movements  often  require  strength  and  endurance. 


Verb 

Synonyms 

Accumulate 

Collect  (a) 

Apply  (a) 

Carry 

Transport 

Check  (c) 

Collect  (a) 

Accumulate 

Convey 

Transfer  (a) 

Depress 

Press 

Discharge  (a) 

anpty 

Drag 

Pull  (a);  Tug 

Ehipty 

Discharge  (a) 

Fill 

Load  (b) 

Load  (b) 

Fill 

Loosen 

Press 

Depress 

Pull  (a) 

Drag;  Tug 

Pull  (b) 

Push 

Shove 

Release  (a) 

Rotate  (a) 

Turn 

Seize 

Shove 

Push 

Take  (a) 

Throw  (a) 

Tighten 

Transfer  (a) 

Convey 

Transport 

Carry 

Tug 

Drag;  Pull  (a) 

Turn 

Rotate  (a) 
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ANNEX  D 
Appendix  1 

Glossary  of  Cost  Variables* 


APATRSli) 

Annual  pay  and  allowances  of  troop  support  (P8  or  P2)  [5.16] 

ASTUPA  (i)  [4,18;  5.15J 

Average  annual  pay  and  allowances  of  students  in  year  i. 

BACIMD(i)  [4.1;  4.14;  4.2J 

Total  cost  of  institutional  instructional  material  development  in  year  i. 

BAINMCCi)  [4.1;  4.15J 

Total  cost  of  maintenance  of  institutional  instructional  material  in 
y«?ar  i. 

BCIMDli)  [4.14J 

Cost  per  student  in  year  i  for  instructional  material  development. 

BCINSKi)  L^.1;  4.17] 

Total  cost  of  pay  and  allowances  of  all  instructors  in  ifistitutional 
base  training  in  year  i. 

BCOPMKi)  [4.13J 

Cost  per  student  of  maintenance  of  variable-cost  ir.stituticr.al  base 
training  equipment  in  year  i. 

BCSQFTli)  L4.11J 

Cost  per  square  foot  of  operation  and  maintenance  of  training  facilities 
in  year  i  (includes  operation,  janitorial  service,  utilities,  etc.). 

BCUIMD  [4.15J 

Average  annual  cost  per  student  for  maintenance  of  instructional  materia).. 
(This  cost  is  assumed  constant  but  could  be  made  variable  on  a  yearly 
basis  by  inserting  the  appropriate  yearly  value  where  used.) 

BDACST(i)  [4;  4.1] 

Total  base  non-disoounted  coats  for  year  i. 

BEAOCKi)  L4.1;  4.12;  4.2] 

Total  cost  of  institutional  base  equipment  acquisition  in  year  i. 


*Numbers  in  brackets  indicate  equations  in  which  these  variables  occur. 
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BEMSCICi) 


L4.1;  4.13] 


Total  cost  of  institutional  base  equipment  maintenance  in  year  i. 

BBQCIS(i)  L4.12J 

Total  cost  of  fixed-cost  institutional  base  training  equipment  acquired 
in  year  i. 

BE)QIMP(i)  1.4. 12J 

Cost  per  student  of  the  variable-cost  institutional  base  training  equipment 
that  must  be  acquired  in  year  i. 

BEQTRSCi)  L4.19J 

Cost  per  student  for  transportation  of  equipment  used  in  institutional 
base  training  in  year  i. 

BFACOS(i)  L4.1;  4.2J 

Total  cost  of  institutional  base  facility  acquisition  in  year  i. 

BFTiCOS(i)  L4.1;  4.-i1J 

Tocal  cost  of  institutional  base  maintenance  of  facilities  in  year  i. 

BINSTR  L4.111;  4.17] 

Ratio  of  instructors  to  students  in  institutional  base  training  (assumed 
constant  from  year  to  year) . 

BOMFEQCi)  L4.13J 

Cost  of  operation  and  maintenance  of  fixed-cost  institutional  base  training 
equipment  in  year  i  (i.e.,  not  associated  with  the  nunber  of  students). 

BOVERH(i)  L4.17J 

Cost  per  student  of  institutional  base  operatior»s  overhead  in  year  i. 

BPALIN(i)  L4.17J 

Average  annual  pay  and  allowances  of  an  instructor  in  institutional  base 
training  in  year  i. 

BPALSr(i)  L4.1;  4.18] 

Total  cost  of  pay  and  allowances  of  students  in  institutional  base  training 
in  year  i. 


BRORAT(i) 


L4.17] 


Ratio  of  average  nunber  of  students  in  initial  training  on  the  particular 
system  to  average  total  ntinber  of  studentii  in  institutional  base  training 
in  year  i. 

BRVAST  L4;  4.2J 

Remaining  value  of  facilities,  equipment,  and  instructional  materials  at 

end  of  planning  period  (N  years) . 

BSQFST  L4..111J 

Number  of  square  feet  of  institutional  base  training  facilities  required 
for  each  student  (assumed  constant  over  entire  planning  period). 

BSQFTA 

Total  square  feet  of  facilities  required  for  administration  associated 
with  initial  training  on  the  system. 

BSUPLYU)  L4.16J 

Cost  per  student  of  institutional  base  supplies  consumed  in  year  i. 

BSUPPY(i)  L4.1;  4.16J 

Total  cost  of  supplies  consumed  in  year  i  in  institutional  base  training. 

BTIME  L4.17i  4.18J 

Fractiofi  of  year  spent  by  each  student  in  insstitutional  base  training. 

BTRANS(i)  L4.1;  4. 19] 

Total  cost  of  travel  (including  per  diem)  and  equipment  transportation  in 
connection  with  institutional  training  in  year  i. 

BTRAVUi)  L4.19j 

Cost  per  student  for  travel  (including  per  diem)  in  corjiection  with 
institutional  base  training  in  year  i. 

BTSQFT(i)  L4.11;  4.111J 

Total  square  feet  of  institutional  base  training  facilities  required  in 

year  i. 

BVALUE  12;  3;  4] 

The  total  training  costs  associates  with  institutional  base  training. 


D-l-3 


d 


L4;  5;  63 


Discount  rate.  DOD  Instruction  7041.3  prescribes  that  the  rate  should  be 
taken  to  lOf. 

EAD  [4.2;  5.2;  6.2] 

Annual  depreciation  rate  of  equipaent(  assumes  straight-line  depteciation) . 

FAD  14.2;  6.2J 

Annual  depreciation  rate  of  facilities  {assumes  strai£dit-line  depreciation). 

FAJtO(i)  L5.13J 

Cost  per  student  of  annunition  expended  in  institutiixial  field  training 
in  year  i. 

PCINST(i)  15.1;  5.14J 

Total  cost  of  pay  and  allowances  in  year  i  of  instructors  of  institutional 
field  training. 

PCONSUCi)  L5.13J 

Cost  per  student  of  aiiscellaneous  consumable:,  consumed  in  instituti(xial 
field  training  in  year  i. 

PCOFMT(i)  L5.12] 

Coat  per  student  of  maintenancs  of  variable-cost  institutional  field 
'  training  equipment  in  year  i. 

FDACST(i)  15,  5.1 J 

Total  non-disoounted  cost  of  institutional  field  training  in  year  i. 

FEAQCKi)  15.1;  5.11;  5.2J 

Total  cost  of  acquisition  in  year  i  of  equipment  required  for  institutional 
field  training. 

FEMiCICi)  L5.1;  5.12J 

Total  cost  in  year  i  of  operation  and  maintenance  of  equipment  required 
for  institutional  field  training. 

FEQDf»(i)  L5.113 

Cost  per  student  of  variable-cost  institutional  field  training  equipment 
that  must  be  acquired  in  year  i. 
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FBQCISd) 


[5.11] 


Total  cost  of  fixed-cost  institutional  field  training  equipment  acquii^ed 
in  year  i. 

FBQTSS(i)  L5.1] 

Total  cost  of  equipment  of  troop  support  units  attributable  to  training 
the  task. 

FINSTR  LS.I'IJ 

Instructor  to  student  ratio  (assisned  constant). 

FOMFEQ(i)  L5.12J 

Cost  of  operation  and  maintenance  of  fixed-cost  institutional  field 
training  equipment . 

FOMIRS(i)  L5.12J 

Cost  of  operation  and  maintenance  of  troop  support  equipment  attributable 
to  training  the  task. 

FPALIN(i)  L5.14] 

Average  annual  pay  and  allowances  of  an  Instructor  in  institutional  field 
training  in  year  i. 

FPALST(i)  L5.1;  5.15] 

Total  cost  of  pay  and  allowances  year  i  of  students  in  institutional 
field  training. 

FPATRS(i)  L5.1;  5.16] 

Total  cost  of  pay  and  allowances  of  t^oop  support  (P8  or  P2)  In  year  i 
for  institutional  field  training. 

FPETRO(i)  L5.13J 

Cost  per  student  of  petroleuQ  pi'oducts  (POL)  consumed  in  institutional 
field  training  in  year  i. 

FRVAST  L5,  5.2J 

Remaining  value  of  equipment  and  instructional  taaterials  used  in  insti¬ 
tutional  field  training  at  end  of  plarjxing  period. 

FSUPPUi)  L6.i;  5.13] 

Total  cost  of  supplies  consumed  in  year  in  instructicxial  field  -raining. 

FTIME  L5.1»i;  ?.15] 

Fraction  of  year  spenc  by  each  student  in  institutional  field  training. 


FTRANS(i) 


Total  oost  of  tran^>ortation  In  year  1  of  equipment  and  materiel  used 
institutional  field  training. 

FVALUE  L2;  3;  5] 

The  total  training  costs  associated  with  Institutional  field  training. 

lAD  L4.2J 

Annual  depreciation  rate  of  Instructional  materials  (assumes  straight-line 
depreciation) . 

IVALUE  Li;  2J 

The  total  training  costa  associated  with  institutional  training. 

M 

Number  of  tasks  contained  in  the  program.  L7J 

»€SL(i)  14.111;  4.12; 

4.14;  4.17] 


Mexlnum  expected  student  load. 
METL(i) 

Maximum  expected  trainee  load. 

N 

Number  of  years  in  planning  period. 


L6.111J 


L4;  4.2;  5;  5.2; 
6;  6.1J 


R  L4.14J 

Nvaber  of  repetitions  of  the  course  in  year  i  (assumed  constant). 


Sl(i) 

L4.13; 

4.15; 

4.16; 

4.17; 

4.13; 

4.19; 

Average  number  of  students  in  institutional  training 

5.11; 

5.12; 

5.13; 

in  year  i. 

5.14; 

5.15] 

SQFTIN 

L4.111 

1 

4 

Nunber  of  square  feet  of  facilities  required  per  instructor  (assiaaed 
constant) . 


TlHl) 

Ninber  of  trainees  in  unit  training  in  year  i. 
TVALUE 


L6.12;  6.13;  6.14: 
6.15;  6.16;  6.17] 


Li;  3;  7] 


Total  costs  attributable  to  initial  trair.lng  on  the  task  or  system  being 
studied. 
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UAfWO(i)  L6.14] 

Cost  per  trainee  of  amnunition  expended  in  unit  trair*ing  in  year  i. 

UCONSUU)  L6.14] 

Cost  per  trainee  of  miscellaneous  consumables  consumed  in  unit  training 
in  year  i. 

UCOPMr(i)  Lb.lSJ 

Cost  per  trainee  of  maintenance  of  variable-cost  unit  training  equipment 
in  year  i. 

UCSQFT(i)  Lb.llj 

Cost  per  square  foot  of  operation  and  maintenance  of  unit  training 
facilities  in  year  i. 

UCTNE(i)  Lb.1;  6.16] 

Total  cost  of  pay  and  allowances  of  trainees  in  unit  training  in  year  i. 

UCTOR(i)  L6.1;  6.15] 

Total  cost  of  pay  and  allowances  of  all  trainers  in  unit  training  in 
year  i. 

UDACST(i)  Lb;  6.1] 

Total  non-discounted  cost  of  unit  training  in  year  i. 

UEAQCKi)  Lb.l;  6.12;  6.2] 

Total  cost  of  unit  training  equipment  acquisition  in  year  i. 

UEhaCIti)  Lb.1;  6.13] 

Total  cost  of  unit  training  equipment  .maintenance  in  year  i. 

UEQCIS(i)  L6.12J 

Cost  of  fixed-cost  equipment  acquired  for  unit  training  in  year  i. 

UEQIMP(i)  L6.12] 

Cost  per  trainee  of  variable-cost  equipment  used  in  unit  training  in 
year  i. 

UEQTRS(i)  L6.17] 

Cost  per  trainee  for  transportation  of  equipment  used  in  unit  training 
in  year  i. 
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UFACOS(i)  [5.1;  6.2] 

Total  cost  of  unit  training  facilities  acquisition  in  year  i. 

UFMCX)S(i)  16. 1;  6.11] 

Total  cost  of  unit  maintenance  of  training  facilities  in  year  i. 

UOMFEQ(i)  L6.13J 

Cost  of  operation  and  maintenance  of  fixed-cost  unit  training  equipment 
in  year  i. 

UPATNE(i)  L6.16J 

Average  annual  pay  and  allowances  of  trainees  in  unit  training  in  year  i. 

UPATNR(i)  L6.15J 

Average  annual  pay  and  allowances  of  a  trainer  in  unit  training  in  year  i. 

UPETROCi)  L6.14J 

Cost  per  trainee  of  petroleum  products  (POL)  consumed  in  unit  training 
in  year  i. 

URVAST  L6;  6.2J 

Remaining  value  of  facilities,  eouipment  and  instructional  materials  used 
in  unit  training  at  end  of  planning  period  (N  years) . 

USQFTA  L6.111] 

Square  feet  of  administrative  facility  space  required  to  support  unit 
training  on  the  particular  system  being  studied.  If  the  space  would 
be  required  even  if  the  system  were  not  being  trained,  this  variable 
would  be  zero. 

USQFTE  Lb.inj 

Square  feet  per  trcinee  of  unit  training  facilities  (assumed  constant). 

USQFTR  L6.niJ 

Square  feet  of  unit  training  facilities  per  trainer  (assumed  constant). 

USUPPY(i)  [6.1;  6.14] 

Total  cost  of  supplies  consumed  in  unit  training  in  year  i. 

UTIME  [6.15;  6.16] 

Fraction  of  year  spent  by  each  trainee  in  unit  training  until  SQT 
is  passed. 
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imjRE 


L6.15] 


Trainer  to  trainee  ratio  in  unit  training  (a^ssumed  constant). 

UTRANS(i)  L6.1;  6.17J 

Total  cost  of  travel  (including  per  diem)  and  equipmait  transportation 
in  connection  with  unit  training  in  year  i. 

UTRAVL(i)  L6.17] 

Cost  per  trainee  for  travel  (including  per  diem)  in  connecticxi  with  unit 
training  in  year  i. 

UTSQFT(i)  L6.11;  6.111] 

Total  square  feet  of  ’jnit  training  facilities  required  in  year  i. 

UVALUE  LI;  3;  6] 

The  total  training  costs  associated  with  unit  training. 
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LITTON  COST  MODEL  SUMMARY 


f 


TVALUE  =  IVALUE  +  UVALUE 

IVALUE  =  BVALUE  +  FVALUE 

TVALUE  =  BVALUE  +  FVALUE  +  UVALUE 

^  EDACST(i)  BRVAST 

BVALUE  =  y 

i=1  (1+d)^ 


BDACST(i)  =  BFACOS(i)  +  BFMCOS(i)  +  BEAQCI(i)  +  BEM3CI(i)  +‘BACIMD(i) 
+  BAIMMC(i)  +  BSUPPY(i)  +  BCINST(i)  +  BPALST(i) 

+  BTRANS(i) 


BFMCOS(i)  •-  BTSQFT(i)  «»  BCSQFT(i) 

BTSQFT(i)  s  (.BSQFST  +  BINSTR  •  SQFTIN]  •  MESL(i)  +  BSQFTA 
BEAQCI(i)  =  BBQIMPCi)  •  MESL(i)  +  BE«CIS(i) 

BEM3CI(i)  =  BCOPMT(i)  «  Sl(i)  +  DOMFBQ(i) 

BACIMD(i)  =  BCIMD  •  MESL(i)  •  R 
BAINWCd)  =  BCUIMD  •  SI(i) 

BSUPPY(i)  =  BSUPLY(i)  •  SI(i) 

BCLNST(i)  =  LBPALIN(i)  •  BINSTR  •  MESL(i)  ♦  BOVERH(i)  •  BRORAT(i) 
SI(i)J  •  BTIME 


(1) 

(2) 

(3) 

(4) 


(4.1) 

(4.11) 
(4.111) 

(4.12) 

(4.13) 

(4.14) 

(4.15) 

(4.16) 

(4.17) 


BPALST(i>  =  ASTUPA(i)  •  BTIME  •  Sl(i)  (4.18) 

BTRANSvi;  =  ETHAVUi)  •  SIu.)  >  BE3TRS(i)  (^.19) 
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N 

BRVAST  =  V  LBFACOS(i)]  •  [l-(FAD)  (N-i+1]  +  [BEAQCI(i)] 
isl 

Ll-(EAD)  (N-i+1)]  +  [BACIMD(i)]  •  [l-(IAD)  (N-i+1)] 

^  FDACST(i)  FRVAST 

FVAliJE  =  y 

i=1  (1+d)^ 

FDACST(i)  =  FEAQCKi)  +  FEKJCKi)  +  FSUPPY(i)  +  FCINST(i)  +  FPAiST(i) 
+  FPATRS(i)  +  FTRANS(i) 

FEAQCKi)  =  FBQIMP(i)  •  SI(i)  +  FEQCIS(i)  +  FBQTRS(i) 

FEMQCKi)  =  FCOPMT(i)  •  SI(i)  +  FOMFBQ(i)  +  FO^!TRS(i) 

FSUPPY(i)  =  LFPETROd)  +  FA^♦0(i)  +  FCONSU(i)]  •  SI(i) 

FCINST(i)  s  FPALIN(i)  •  FINSTR  •  FTIME  •  SI(i) 

FPALST(i)  =  ASTUPA(i)  •  FTIME  •  SI(i) 

FPATFS(i)  =  APATRS(i)  •  FTIMEl 
N 

FRVAST  =  2  LFEAQCKDJ  •  U-CEAD)  (N-i+1)] 
i=l 

^  UDACST(i)  URVAST 

UVALUE  =  y 

iri  U+d)^^"'’'  (1+a)^ 

UTACSTCi)  =  UFACOS(i)  +  UFWCOS(i)  +  UEAQCKi)  +  UEM5CI(i)  +  USL7PY(i) 
+  UCTNP(i)  +  UCINE(i>  *  'JTRANS(i) 

UF>4COS(  i )  =  UTSqn  ( i )  •  UCSCFT(  i ) 

UTSCPKi)  =  lUSCFST  L'TNRE  •  USQFTR]  •  MEK(i)  +  USQFTA 


(4.2) 


(5) 

(5.1) 

(5.11) 

(5.12) 

(5.13) 

(5.14) 

(5.15) 

(5.16) 

(5.2) 

(6) 

(6.1) 

(6.11) 

(6.111) 
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UEAQCI(i)  =  UEaiMP(i)  •  TU(i)  +  UEQCIS(i) 


(6.12) 


UEMQCKi)  =  UOOPMT(i)  •  TU(i)  +  UOME-'EQCl) 

USUPPY(i)  =  [UPETRO(i)  +  UAhWOCi)  +  UNOONSU(i)]  «  TU(i) 

UCTNR(i)  s  UPATNR(l)  •  UTNRE  •  UTIME  •  TU(i) 

UCTNE  =  UPATNE(i)  •  UTIME  •  TU(1) 

UTRANS(i)  =  UTRAVL(i)  •  TU(i)  +  UBQTRS(i) 

N 

URVAST  =  ^  LUFACOS(l)]  •  C1-(FAD)  (N-i+1]  + 
LUEACaCl)]*  C1-(EAD)  (N-i+1)] 


TPROGR  s 


TVALUEj 


(6.13) 

(6.14) 

(6.15) 

(6.16) 
(6.17) 

(6.2) 

(7) 
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TASK  DESCRIPTION 


Appendix  2 


Exan?)le5  of  Reasons  for  Including  Variables  in  a  Task  Description  (adapted 
fnxn  Hawley  and  Thomason,  1978). 

Task  31.00  (Perform  Monthly  System  Checks) 


Variable  Type, 

Moiiber  and  Name 

Stimulus  Variables 

1.  Visual  Cues 

2.  Audio  Cues 

3.  Tactile  Cues 

8.  Visual  Alphanumeric 

9.  Visual  Symbolic 

10.  Visual  Graphic 

14.  Visual  Still 

15.  Visual  Limited  Movement 
18.  Black  and  White 

19 r  Gray  Scale 
24.  Bright  Visual 
26.  Voice  Sound 
30.  Strong  Audio 
32.  Dynsmic  ^  Ordered 
34.  Slow  Rate 
39.  Group 

Response  Variables 

1.  Overt  Response  -  Verbal 

2.  Overt  Response  -  Written 

3.  Overt  Response  *■  Manipulation 

5.  Overt  Response  >  Procedural 

7.  Strong  Response  Intensity 


Reason  for  Inclusion 

Visual  Inspections  made 

Auditory  check  of  com.  system 

Tactile  switch  checks 

KPU  printouts 

CRT  display  checks 

CRT  display  checks 

KPU  printouts 

Switch  panels  used 

KPU  printouts 

CRT  display 

Inspections  made  in  good  light 
Com.  System 

Audio  signals  readily  audible 
Inspection  made  in  specified  order 
Inspector  proceeds  at  own  speed 
Ius{>cctlon  conducted  by  crew 

Some  voice  responses  required 

Record  results  of  system  checks 

Use  of  KPU,  switches,  etc. 

Specified  Inspection  procedures 
used 

Responses  are  definite 
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9. 

Dynamic  -  Ordered  Response 

Responses  are  sequential 

11. 

Slow  Response  Rate 

Inspector  Responds  at  tnm  rate 

13. 

Limited  Response  Channels 

Response  types  are  specified 

16. 

Group  response 

Inspection  by  crew 

Feedback  Variables 

1. 

Visual  Feedback 

Feedback  from  displays 

3. 

Written  Feedback 

Feedback  from  KPU 

4. 

Face-to~Face  Comm. 

Feedback  from  other  crew  members 

10. 

Intrinsic  Feedback 

Feedback  modes  built  into  sys¬ 
tem 

15. 

System  Status 

Feedback  concerns  system  status 

17. 

Group  Distribution 

Inspection  by  crew 

Methodological  (Functional 

Context)  Variables 

1. 

Supervisory 

Senior  Opera tor/Repairman  super¬ 
vises 

5. 

Physical 

Inspection  involves  physical 
manipulations 

6. 

Perceptual 

Perception  of  system  responses 
required 

7. 

Communlcacive 

Communication  between  crew  /re¬ 
quired 

9. 

Stable  Function 

Procedure  is  specified  and  un¬ 
changing 

10. 

Low  Physical  Impact 

Procedure  unaffected  by  physical 
environment 

12. 

Low  Psychological  Impact 

Procedure  unaffected  by  psycholo¬ 
gical  environment 

MOTE:  See  Annex  A  (TEEM)  for  descriptions  of  these  variables. 
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V 
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AD 

AIT 

AP 

APM 

AB 

ARTEP 

ASARC 

ASI 

ATM 

ATSC 

BDM/CARAF 

BOIP 

BOIPT 

BT 

CDS 

C/E 

CFP 

CHPT 

COEA 

COI 

COI? 

CRT 

CTEA 

DA 


LIST  OF  ABBRP/IATIONS  AND  ACRONYMS 

Advancea  Development 
Advanced  Individual  Training 
Acquisition  Plan 
Army  Program  Memorandvan 
Army  Regulation 

Array  Training  and  Evaluation  Program 
Army  Systems  Acquisition  Review  Council 
Additional  Skill  Identifier 
Analogous  Task  Method 

Affray  Training  Suppcrt  Center  (Fort  Eustis,  VA) 

The  BDM  Service  Company  Combined  Anns  Research  ar.d 
Analysis  Facility 

Basis  of  Issue  Plan 

Basis  of  Issue  Plan  -  Tentative 

Basic  Training 

Consolidated  Data  Base 

Cost  Effectiveness 

Concept  For-mulation  Package 

CoordLnated  Human  Resources  Technology 

Cost  and  Operational  Effectiveness  Analysis 

Course  of  Instruction 

Consequence  of  Inadequate  Performance 

Cathode  Ray  Tube 

Cost  and  Training  Effectiveness  Analysis 
Departnent  of  the  Anry 


DARCOM 

DCD 

DCP 

DIO 

DP 

DRTJ4S 

DSARC 

DT 

DT/OT 

DTD 

EEA 

FYDP 

HRDT 

ILS 

IPR 

IPS 

IRTA 

ISD 

ISP 

ITC 

ITDT 

ITP 

ITV 

JGD 

LCC 

LCCE 

LCSffI 


U.S.  Array  Materiel  Development  and  Readiness  Cormand 
Department  of  Combat  Developments 
Decision  Coordinating  Paper 
Director  of  Industrial  Operations 
Develo^ient  Plan 

Diagnostic  Rifle  Marksmanship  Simulators 
Defense  System  Acquisition  Review  Council 
Development  Test 

Development  Test/Operational  Test 

Directorate  of  Training  Developmenta 

Essential  Elements  of  Analysis 

Five  Year  Defense  Plan 

Human  Resources  in  Design  Trade-Offs 

Integrated  Logistic  Suppo»’t 

In-Process  Review 

Integrated  Personnel  Support 

Integrated  Requirements  and  .Tasks  Analysis 

Instructional  Systems  Development 

Integrated  Support  Plan 

Institutional  Training  Cost 

Integrated  Technical  Documentation  and  Training 

Individual  Training  Plan 

Improved  TOW  Vehicle 

Jcb  Guide  Development 

Life  Cycle  Costs 

Life  Cycle  Cost  Elements 

Life  Cycle  System  '^an'',ger.ent  Model 
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LOA 


V 


LOGCEN 

LR 

LSA 

LSAR 

MENS 

MILPERCEN 

hkMA 

rm 

MDS 

MDDIA 

MOD 

MOTE 

MPA 

NET 

OAP 

ODP 

OICTP 

CXJT 

OHA 

OSUT 

OT 

Ph 

PIP 

PM 

?OI 

POL 

pp: 


Letter  of  Agreement 

Logistics  Center 

Letter  Requii’ement 

Logistic  Support  Analysis 

Logistic  Support  Analysis  Record 

Mission  Element  Needs  Statement 

Military  Personnel  Center 

Maintenance  Manpower  Modeling 

Military  Occupational  Specialty 

Methcd  of  Designing  Instruction  Alternatives 

Modification 

Measures  of  Trairdng  Effectiveness 

Militar'y  Perso.nnel,  Ani?y 

New  Equipment  Training 

Outline  Acquisition  Plan 

Outline  Development  Plan 

Outlinq  Incividual  Collective  Training  Plan 

On-the-job  Training 

Operations  and  Maintenance,  kray 

One  Station  Unit  Training 

Operational  Test 

Probability  of  Hit 

Product  Improvement  Program 

Prcject/Progran/Product  Manager 

Program  of  Instruction 

Petrolevm,  Oil  and  Lubricants 

Plan  Position  Indicator 


PQQPRI 

PROC 

QQPRI 

RAM 

RDTE 

RFA 

RCC 

HTE 

RUM 

SAT 

SOC 

SQT 

TASA 

TASC 

TASO 

TAEG 

TCA 

TCP 

TEC 

TECEP 

TDDA 

TDIS 

TDR 

TDT 

TEEM 

TLD 


Provisional  Qualitative  and  Quantitative  Personnel 
Requirements  Information 

Procurement 

Qualitative  and  Quantitative  Personnel  Requirements 
Information 

Reliability,  A'*  ■  liability,  Maintainability 
Research,  Development,  Test  and  Evaluation 
Rirafire  Adapter 

Required  Operational  Capability 

Relative  Training  Effectiveness 

Resource  Utilization  t'todel 

systems  Approach  to  Training 

Svstem  Ownership  Cost 

Skill  Qualificaticxi  Teat 

Task  and  Skill  Analysis 

Training  Aids  Service  Center 

Training  Aids  Service  Office 

Training  Analysis  and  Evaluation  Group 

Training  Consonance  Analysis 

Training  Consonance  Ratio 

Training  Extension  Course 

.'raining  Evaluation  Cost  Evaluation  Program 

"raining  Developers  Decision  Aid 

Training  Developments  Information  System 

Training  Device  Requirement 

Task  Delay  Tolerance 

Training  Efficiency  Eatimation  Model 

TasK  Learning  Difficu.’ty 
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TM 

Technical  Manual 

TMON 

Technical  Manual  on 

TOCI 

Training  Option  Cost  Indicator 

TOE 

Table  of  Organization  ana  Squipaent 

TQQPRI 

Tentative  Qualitative  and  Quantitative  Personnel 
Requirements  Information 

TRADOC 

Training  and  Doctrine  Connand 

TRAINVICE 

Training  Device  Effectiveness  Model 

TRAM 

Training  Analysis  Model 

TRAMOD 

Training  Requirements  Analysis  Model 

TSD 

Training  System  Design 

TSM 

TRADOC  System  Manager 

TTC 

Total  Training  Ccst 

UI 

User  Interface 

UTC 

Unit  Training  Cost 

WSTEA 

Weapon  System  Effectiveness  Analysis 

% 


